00000001:02000400:1.0F:1783966598.544998:0:3300:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_hostid 00000001:02000400:1.0:1783966620.590951:0:3521:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1783966622.205132:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 771 MB/s 00000001:01000000:0.0:1783966622.455101:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1551 MB/s 00000001:01000000:2.0F:1783966622.704822:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4535 MB/s 00000020:02000000:0.0:1783966623.780640:0:3614:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gc83a79c 00000400:02000000:2.0:1783966625.063970:0:3629:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.204.159@tcp [8/256/0/180] 00008000:02000000:2.0:1783966628.788298:0:3778:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1783966696.577429:0:5745:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783966713.693212:0:6495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783966713.693218:0:6495:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783966713.693219:0:6495:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783966713.693361:0:6495:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000683e0251 00000080:02000400:2.0:1783966713.693371:0:6495:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783966713.707986:0:6495:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783966713.708001:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783966713.709670:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007a0d0f81) 00000020:00000080:1.0:1783966713.709698:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783966713.818969:0:6495:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783966713.819094:0:6495:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1783966713.870089:0:6495:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783966713.870398:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783966713.870406:0:6495:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783966713.870418:0:6495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160668ea 00000020:01000004:3.0:1783966713.870425:0:6495:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783966713.870430:0:6495:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783966713.870435:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000683e0251 from MGS 00000020:01000004:3.0:1783966713.870439:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783966713.870458:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000eec4a3e7) 00000020:00000080:3.0:1783966713.870470:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783966713.870643:0:6495:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000683e0251 from MGS, refs=2 00080000:01000000:3.0:1783966713.870650:0:6495:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783966713.870658:0:6495:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160668f8 00000100:00100000:3.0:1783966713.870756:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783966713.871217:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783966713.871223:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783966713.871917:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783966713.871926:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783966713.876104:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783966713.877755:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783966713.878099:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783966713.880229:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783966713.880240:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783966713.880680:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783966713.880686:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783966713.882816:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966713.882821:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966713.882823:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966713.883378:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966713.883381:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966713.883382:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966713.894381:0:6495:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783966713.896802:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1783966714.143944:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2419 MB/s 00000001:01000000:3.0:1783966714.394014:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2555 MB/s 00000001:01000000:2.0:1783966714.648755:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 248 MB/s 00000001:01000000:2.0:1783966714.901412:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 334 MB/s 00080000:10000000:1.0:1783966714.935847:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1783966714.936393:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783966714.986324:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1783966714.998090:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783966714.998208:0:6495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783966714.998297:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1783966714.998578:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783966714.998605:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783966714.998981:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783966714.999431:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783966714.999439:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783966715.000224:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783966715.000232:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783966715.002054:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783966715.002063:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783966715.003865:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783966715.003888:0:6495:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:0.0:1783966715.003890:0:6495:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783966715.003934:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:0.0:1783966715.003953:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (00000000ab7a971a) 00000020:00000080:0.0:1783966715.003971:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1783966715.004234:0:6513:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1783966715.006187:0:6495:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e7db6a3e@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783966715.012192:0:6495:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:0.0:1783966715.012206:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783966715.018992:0:6515:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783966715.019470:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 8e80b464-a486-4100-b63a-6e6116a9d437) 00000020:00000080:0.0:1783966715.019494:0:6495:0:(genops.c:1406:class_connect()) connect: client 8e80b464-a486-4100-b63a-6e6116a9d437, cookie 0x9269c8b316066906 00000100:00080000:0.0:1783966715.019505:0:6495:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783966715.019510:0:6495:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import 00000000e7db6a3e using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966715.019564:0:6495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007dfc257e x1870624587776128/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783966715.031977:0:6495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8e80b464-a486-4100-b63a-6e6116a9d437->MGS 00000020:01000004:0.0:1783966715.031999:0:6495:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783966715.032006:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783966715.032022:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a48b319) 00000020:00000080:0.0:1783966715.032062:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783966715.032469:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007dfc257e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587776128:0@lo:250: 00000100:00100000:1.0:1783966715.032570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966715.032635:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776128 00000100:00100000:1.0:1783966715.032654:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776128 00000100:00100000:1.0:1783966715.032683:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966715.032689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000367b1ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870624587776128:12345-0@lo:250: 00010000:00080000:1.0:1783966715.032711:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8e80b464-a486-4100-b63a-6e6116a9d437@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1783966715.032733:0:6510:0:(genops.c:1406:class_connect()) connect: client 8e80b464-a486-4100-b63a-6e6116a9d437, cookie 0x9269c8b316066914 00000100:00080000:1.0:1783966715.032870:0:6510:0:(import.c:65:import_set_state_nolock()) 000000007337aaf6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966715.032918:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000367b1ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+5:3644:x1870624587776128:12345-0@lo:250: Request processed in 228us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966715.032924:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966715.032963:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783966715.032972:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:1.0:1783966715.032977:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783966715.032981:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783966715.032984:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000e7db6a3e MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783966715.032986:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783966715.033000:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783966715.033005:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007dfc257e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587776128:0@lo:250: 00000100:00100000:2.0:1783966715.062193:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783966715.062731:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783966715.062738:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783966715.068011:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783966715.068030:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783966715.068537:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783966715.068555:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783966715.070363:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783966715.070544:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783966715.070743:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783966715.090061:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783966715.090083:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783966715.184494:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783966715.186708:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783966715.186730:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783966715.199960:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783966715.199974:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783966715.200982:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783966715.201346:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783966715.201352:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783966715.203187:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783966715.203200:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783966715.208146:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783966715.208344:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783966715.208350:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783966715.209652:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783966715.209661:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783966715.210289:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783966715.210457:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783966715.210461:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783966715.211727:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783966715.211735:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783966715.277340:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783966715.277543:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783966715.277549:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783966715.288281:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783966715.288295:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783966715.289630:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783966715.289641:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783966715.291034:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783966715.291078:0:6495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783966715.291085:0:6495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783966715.291200:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783966715.291245:0:6495:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783966715.291254:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783966715.291255:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783966715.291256:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966715.291257:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966715.291258:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966715.291259:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966715.291260:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966715.291261:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783966715.291262:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966715.291264:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966715.291265:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966715.291266:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783966715.291268:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783966715.291270:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783966715.291271:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783966715.291272:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966715.291273:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966715.291274:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966715.291275:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966715.291275:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966715.291276:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783966715.291277:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966715.291278:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966715.291278:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966715.291279:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783966715.291314:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783966715.291333:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8380967 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776256:0@lo:253: 00000100:00100000:2.0:1783966715.291408:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.291466:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd699422 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.291641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776256 00000100:00100000:3.0:1783966715.291649:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776256 00000100:00100000:3.0:1783966715.291691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783966715.291699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c23599a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+5:6495:x1870624587776256:12345-0@lo:253: 20000000:01000000:3.0:1783966715.291756:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783966715.291758:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783966715.292429:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783966715.292478:0:6512:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1783966715.292750:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966715.295974:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1783966715.303505:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783966715.303513:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1783966715.303520:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1783966715.303523:0:6512:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1783966715.303534:0:6512:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1783966715.303764:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966715.303928:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1783966715.303940:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783966715.303955:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1783966715.303968:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1783966715.303979:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1783966715.304036:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1783966715.304055:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1783966715.304068:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1783966715.304072:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1783966715.304081:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1783966715.304085:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1783966715.304102:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1783966715.304114:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1783966715.304137:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783966715.304141:0:6512:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1783966715.304147:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966715.304495:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1783966715.304505:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783966715.304520:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1783966715.304531:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1783966715.304595:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1783966715.304605:0:6512:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1783966715.304626:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1783966715.304632:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783966715.304641:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1783966715.304653:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1783966715.304664:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1783966715.304670:0:6512:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1783966715.304687:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1783966715.304693:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1783966715.305078:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1783966715.305095:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1783966715.305155:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1783966715.305174:0:6512:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1783966715.305180:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1783966715.306212:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1783966715.310458:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1783966715.310493:0:6512:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.159@tcp for mdt 20000000:01000000:3.0:1783966715.310496:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:3.0:1783966715.310513:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1783966715.310519:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1783966715.310534:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1783966715.310553:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:3.0:1783966715.310570:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1783966715.310593:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1783966715.310611:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1783966715.310628:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1783966715.310660:0:6512:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783966715.310664:0:6512:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783966715.310668:0:6512:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783966715.310745:0:6512:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783966715.310748:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783966715.319475:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1783966715.319887:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1783966715.319916:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1783966715.319931:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1783966715.319941:0:6512:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783966715.319943:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783966715.320866:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783966715.321074:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783966715.321099:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783966715.321115:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1783966715.321126:0:6512:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783966715.321128:0:6512:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1783966715.321132:0:6512:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783966715.321134:0:6512:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783966715.321139:0:6512:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783966715.321153:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783966715.333244:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1783966715.333423:0:6512:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783966715.347148:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1783966715.347381:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1783966715.347400:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1783966715.347420:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783966715.347441:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347458:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347470:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347476:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347483:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347505:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347511:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a679dffe already unused, calling callback (000000005001ecdc) 00010000:00010000:3.0:1783966715.347515:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347522:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.347533:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.351149:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.351677:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a679dffe/0x9269c8b31606691b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783966715.352341:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783966715.388469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c23599a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+5:6495:x1870624587776256:12345-0@lo:253: Request processed in 96763us (97054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.388485:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966715.391871:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8380967 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776256:0@lo:253: 10000000:01000000:2.0:1783966715.391902:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783966715.391915:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783966715.391917:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783966715.391919:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966715.391920:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783966715.391921:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966715.391922:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966715.391924:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966715.391925:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783966715.391926:0:6495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783966715.391928:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966715.391929:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783966715.391954:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000683e0251 from lustre-MDT0000 10000000:01000000:2.0:1783966715.391986:0:6495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783966715.391989:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783966715.391993:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a05c3468000 10000000:01000000:2.0:1783966715.391997:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783966715.392005:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:2.0:1783966715.392008:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783966715.392057:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.392067:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.392076:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.392095:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d8380967 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776384:0@lo:101: 00000100:00100000:2.0:1783966715.392175:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.392224:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c0e3f47 going to sleep for 11 seconds 00000100:00100000:0.0:1783966715.393122:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776384 00000100:00100000:0.0:1783966715.393132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776384 00000100:00100000:0.0:1783966715.393190:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966715.393199:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025e0d254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+5:6495:x1870624587776384:12345-0@lo:101: 00010000:00010000:0.0:1783966715.393220:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966715.393238:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066922 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966715.393263:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066922 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966715.393273:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066922 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966715.393284:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a8c2187, rc 0) 00000100:00100000:0.0:1783966715.393349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025e0d254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+6:6495:x1870624587776384:12345-0@lo:101: Request processed in 150us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966715.393355:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783966715.393475:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d8380967 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776384:0@lo:101: 00010000:00010000:3.0:1783966715.393491:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.393499:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966715.393596:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776512:0@lo:501: 00000100:00100000:3.0:1783966715.393651:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.393686:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d019fe71 going to sleep for 11 seconds 00000100:00100000:0.0:1783966715.394682:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776512 00000100:00100000:0.0:1783966715.394692:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776512 00000100:00100000:0.0:1783966715.394746:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783966715.394754:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022d2c127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+6:6495:x1870624587776512:12345-0@lo:501: 00000100:00100000:0.0:1783966715.394889:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022d2c127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+6:6495:x1870624587776512:12345-0@lo:501: Request processed in 136us (1237us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783966715.394897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783966715.395191:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776512:0@lo:501: 10000000:01000000:3.0:1783966715.395224:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783966715.395237:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395247:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966715.395255:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05ed1cf800 10000000:01000000:3.0:1783966715.395260:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783966715.395263:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a05ed1cf800 10000000:01000000:3.0:1783966715.395265:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783966715.395268:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a05ed1cf800 from 1 10000000:01000000:3.0:1783966715.395270:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783966715.395295:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395302:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395310:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966715.395324:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776640:0@lo:101: 00000100:00100000:3.0:1783966715.395367:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.395403:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d019fe71 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.395421:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776640 00000100:00100000:3.0:1783966715.395425:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776640 00000100:00100000:3.0:1783966715.395445:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966715.395450:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005098350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+6:6495:x1870624587776640:12345-0@lo:101: 00010000:00010000:3.0:1783966715.395458:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966715.395468:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b8eec12/0x9269c8b316066937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066930 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395484:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b8eec12/0x9269c8b316066937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066930 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395493:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b8eec12/0x9269c8b316066937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066930 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395500:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b8eec12, rc 0) 00000100:00100000:3.0:1783966715.395530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005098350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+7:6495:x1870624587776640:12345-0@lo:101: Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.395535:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966715.395564:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776640:0@lo:101: 00010000:00010000:3.0:1783966715.395574:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395581:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966715.395591:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783966715.395594:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395606:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000004f3832f8/0x9269c8b316066930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966715.395611:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783966715.395614:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783966715.395630:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a05ed1cf800 10000000:01000000:3.0:1783966715.395633:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783966715.395636:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783966715.395637:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783966715.395651:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395657:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395662:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966715.395671:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776768:0@lo:101: 00000100:00100000:3.0:1783966715.395695:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.395707:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d019fe71 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.395720:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776768 00000100:00100000:3.0:1783966715.395723:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776768 00000100:00100000:3.0:1783966715.395739:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966715.395743:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c8ff00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+7:6495:x1870624587776768:12345-0@lo:101: 00010000:00010000:3.0:1783966715.395750:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966715.395756:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b31606693e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395795:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b31606693e expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395803:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b31606693e expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395809:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7e79755, rc 0) 00000100:00100000:3.0:1783966715.395837:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c8ff00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+8:6495:x1870624587776768:12345-0@lo:101: Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.395842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966715.395869:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776768:0@lo:101: 00010000:00010000:3.0:1783966715.395878:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.395884:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966715.395925:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776896:0@lo:501: 00000100:00100000:3.0:1783966715.395949:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.395961:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d019fe71 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.395972:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587776896 00000100:00100000:3.0:1783966715.395975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587776896 00000100:00100000:3.0:1783966715.395991:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966715.395996:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cacef62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+8:6495:x1870624587776896:12345-0@lo:501: 00000100:00100000:3.0:1783966715.396098:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cacef62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6495:x1870624587776896:12345-0@lo:501: Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.396104:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966715.396143:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587776896:0@lo:501: 00000100:00100000:3.0:1783966715.396168:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777024:0@lo:503: 00000100:00100000:3.0:1783966715.396205:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.396217:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e315855 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.396229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777024 00000100:00100000:3.0:1783966715.396234:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777024 00000100:00100000:3.0:1783966715.396251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966715.396256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c8a78c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6495:x1870624587777024:12345-0@lo:503: 00000100:00100000:3.0:1783966715.396321:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c8a78c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6495:x1870624587777024:12345-0@lo:503: Request processed in 66us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.396328:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966715.396365:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777024:0@lo:503: 00000100:00100000:3.0:1783966715.407244:0:6540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6540:1870624587777152:0@lo:502: 00000100:00100000:3.0:1783966715.407350:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.407433:0:6540:0:(client.c:2702:ptlrpc_set_wait()) set 0000000031a39088 going to sleep for 11 seconds 00000100:00100000:0.0:1783966715.408367:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777152 00000100:00100000:0.0:1783966715.408384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777152 00000100:00100000:0.0:1783966715.408444:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783966715.408452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013c99222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6540:x1870624587777152:12345-0@lo:502: 00000100:00100000:0.0:1783966715.408599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013c99222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6540:x1870624587777152:12345-0@lo:502: Request processed in 147us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966715.408607:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783966715.410367:0:6540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6540:1870624587777152:0@lo:502: 00000020:01000000:3.0:1783966715.410420:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966715.410433:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966715.410435:0:6540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783966715.410440:0:6540:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783966715.410443:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783966715.410457:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001d163dfc) 00000020:00000080:3.0:1783966715.410473:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783966715.410478:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783966715.410588:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783966715.410597:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066953 00000020:00000080:3.0:1783966715.411253:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783966715.411265:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966715.411268:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966715.411270:0:6540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783966715.411272:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966715.411275:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966715.411276:0:6540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783966715.411280:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783966715.411288:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d35d4dc5) 00000020:00000080:3.0:1783966715.411298:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783966715.411302:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783966715.411304:0:6540:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783966715.411306:0:6540:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783966715.411312:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783966715.411380:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000683e0251 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783966715.411394:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000f1f95a2) 00000020:00000080:3.0:1783966715.411401:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783966715.411471:0:6540:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783966715.411477:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066968 00000020:00000080:3.0:1783966715.411574:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783966715.411581:0:6540:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783966715.411585:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9269c8b31606696f 00080000:01000000:3.0:1783966715.411591:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783966715.411595:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066976 00080000:10000000:0.0:1783966715.422574:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783966715.423074:0:6540:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783966715.430521:0:6540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783966715.621677:0:6540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783966715.622005:0:6540:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783966715.637237:0:6540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783966715.639636:0:6540:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783966715.646261:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000091ce8449) 00000020:00000080:1.0:1783966715.646284:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783966715.646361:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783966715.646368:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066984 00000020:00000080:2.0:1783966715.648447:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1783966715.653940:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1783966715.658443:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1783966715.663193:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1783966715.668652:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1783966715.671116:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1783966715.674967:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1783966715.677227:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9269c8b31606698b 00000020:00000080:1.0:1783966715.678173:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783966715.678185:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966715.678191:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966715.678193:0:6540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783966715.678196:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966715.678200:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966715.678202:0:6540:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783966715.678204:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783966715.678206:0:6540:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783966715.678215:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966715.678218:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966715.678219:0:6540:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783966715.678221:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966715.678226:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966715.678227:0:6540:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783966715.678231:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783966715.678274:0:6540:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1783966715.678342:0:6540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f4a9044 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6540:1870624587777280:0@lo:502: 00000100:00100000:1.0:1783966715.678418:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966715.678509:0:6540:0:(client.c:2702:ptlrpc_set_wait()) set 0000000087c0ab46 going to sleep for 11 seconds 00000100:00100000:0.0:1783966715.678662:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777280 00000100:00100000:0.0:1783966715.678670:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777280 00000100:00100000:0.0:1783966715.678846:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783966715.678856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006617a269 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+9:6540:x1870624587777280:12345-0@lo:502: 00000100:00100000:0.0:1783966715.678984:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006617a269 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+9:6540:x1870624587777280:12345-0@lo:502: Request processed in 129us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966715.678991:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783966715.679114:0:6540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f4a9044 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6540:1870624587777280:0@lo:502: 00000020:01000000:1.0:1783966715.679143:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966715.679148:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966715.679149:0:6540:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1783966715.679153:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1783966715.679313:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1783966715.679332:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783966715.679351:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.679361:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966715.679369:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05ed1cf800 from 1 10000000:01000000:2.0:1783966715.679372:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783966715.679397:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.679403:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.679411:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.679424:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777408:0@lo:101: 00000100:00100000:2.0:1783966715.679453:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.679649:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ced9ae1 going to sleep for 11 seconds 00000100:00100000:3.0:1783966715.679819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777408 00000100:00100000:3.0:1783966715.679825:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777408 00000100:00100000:3.0:1783966715.679850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783966715.679856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfc3caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:6495:x1870624587777408:12345-0@lo:101: 00010000:00010000:3.0:1783966715.679865:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966715.679877:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066992 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.679905:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066992 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.679915:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066992 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.679923:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a679dffe, rc 0) 00000100:00100000:3.0:1783966715.679960:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfc3caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+10:6495:x1870624587777408:12345-0@lo:101: Request processed in 105us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.679966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783966715.680051:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777408:0@lo:101: 00010000:00010000:2.0:1783966715.680063:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.680081:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.680667:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777536:0@lo:256: 00000100:00100000:2.0:1783966715.680913:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.680976:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ced9ae1 going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.681022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777536 00000100:00100000:1.0:1783966715.681027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777536 00000100:00100000:3.0:1783966715.681082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783966715.681090:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086737d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+10:6495:x1870624587777536:12345-0@lo:256: 20000000:01000000:3.0:1783966715.681106:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783966715.681111:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783966715.681183:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086737d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+10:6495:x1870624587777536:12345-0@lo:256: Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.681191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783966715.681260:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777536:0@lo:256: 10000000:01000000:2.0:1783966715.681969:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783966715.681988:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.681998:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966715.682005:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ed1cf800 from 1 10000000:01000000:2.0:1783966715.682008:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783966715.682041:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682049:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682057:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.682070:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777664:0@lo:101: 00000100:00100000:2.0:1783966715.682101:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.682130:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ced9ae1 going to sleep for 11 seconds 00000100:00100000:2.0:1783966715.682153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777664 00000100:00100000:2.0:1783966715.682158:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777664 00000100:00100000:2.0:1783966715.682190:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966715.682196:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de99d192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+10:6495:x1870624587777664:12345-0@lo:101: 00010000:00010000:2.0:1783966715.682204:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966715.682216:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160669a0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682237:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682246:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682253:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054f98fea, rc 0) 00000100:00100000:2.0:1783966715.682283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de99d192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587777664:12345-0@lo:101: Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966715.682289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966715.682324:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777664:0@lo:101: 00010000:00010000:2.0:1783966715.682334:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.682341:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.682387:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777792:0@lo:501: 00000100:00100000:2.0:1783966715.682410:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.682421:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ced9ae1 going to sleep for 11 seconds 00000100:00100000:2.0:1783966715.682440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777792 00000100:00100000:2.0:1783966715.682444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777792 00000100:00100000:2.0:1783966715.682465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783966715.682470:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef202c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587777792:12345-0@lo:501: 00000100:00100000:2.0:1783966715.683061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef202c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587777792:12345-0@lo:501: Request processed in 590us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966715.683069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783966715.683230:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004bd2625d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777792:0@lo:501: 00000100:00100000:0.0:1783966715.683261:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777920:0@lo:503: 00000100:00100000:0.0:1783966715.683303:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966715.683337:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000009afd42ea going to sleep for 11 seconds 00000100:00100000:2.0:1783966715.683378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587777920 00000100:00100000:2.0:1783966715.683382:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587777920 00000100:00100000:2.0:1783966715.683454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783966715.683461:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b91340a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587777920:12345-0@lo:503: 00000040:00080000:2.0:1783966715.683492:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783966715.683544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b91340a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587777920:12345-0@lo:503: Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966715.683551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783966715.683814:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587777920:0@lo:503: 00000040:00080000:0.0:1783966715.684693:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783966715.684950:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783966715.684971:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783966715.684991:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.685000:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966715.685055:0:6495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783966715.685058:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05ed1cf800 10000000:01000000:2.0:1783966715.685062:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05ed1cf800 10000000:01000000:2.0:1783966715.685066:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783966715.685071:0:6495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ed1cf800 from 1 10000000:01000000:2.0:1783966715.685073:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783966715.685110:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.685118:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.685127:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.685143:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000135ed05f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778048:0@lo:101: 00000100:00100000:2.0:1783966715.685186:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.685217:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e88f8143 going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.685308:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778048 00000100:00100000:1.0:1783966715.685314:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778048 00000100:00100000:1.0:1783966715.685356:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783966715.685363:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dcb9518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+11:6495:x1870624587778048:12345-0@lo:101: 00010000:00010000:1.0:1783966715.685374:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966715.685387:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160669ae expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966715.685408:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160669ae expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966715.685418:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669ae expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966715.685432:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c140b1ef, rc 0) 00000100:00100000:1.0:1783966715.685474:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dcb9518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778048:12345-0@lo:101: Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966715.685480:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783966715.685651:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000135ed05f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778048:0@lo:101: 00010000:00010000:0.0:1783966715.685664:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966715.685672:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966715.685816:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778176:0@lo:501: 00000100:00100000:0.0:1783966715.685844:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966715.685865:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be352d98 going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.685959:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778176 00000100:00100000:1.0:1783966715.685964:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778176 00000100:00100000:1.0:1783966715.686025:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783966715.686042:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003474645d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778176:12345-0@lo:501: 00000100:00100000:1.0:1783966715.686167:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003474645d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778176:12345-0@lo:501: Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966715.686175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783966715.686230:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778176:0@lo:501: 00000100:00100000:0.0:1783966715.686260:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778304:0@lo:503: 00000100:00100000:0.0:1783966715.686299:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966715.686516:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be352d98 going to sleep for 11 seconds 00000100:00100000:2.0:1783966715.686790:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778304 00000100:00100000:2.0:1783966715.686795:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778304 00000100:00100000:2.0:1783966715.686822:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783966715.686829:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de207c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778304:12345-0@lo:503: 00000100:00100000:2.0:1783966715.686915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de207c2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778304:12345-0@lo:503: Request processed in 87us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966715.686922:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783966715.687029:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778304:0@lo:503: 00000100:00100000:0.0:1783966715.687462:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6545:1870624587778432:0@lo:502: 00000100:00100000:0.0:1783966715.687500:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966715.687529:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 00000000821603c5 going to sleep for 11 seconds 00000100:00100000:2.0:1783966715.687639:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778432 00000100:00100000:2.0:1783966715.687644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778432 00000100:00100000:2.0:1783966715.687674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783966715.687680:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a9065d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:6545:x1870624587778432:12345-0@lo:502: 00000100:00100000:2.0:1783966715.687940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a9065d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:6545:x1870624587778432:12345-0@lo:502: Request processed in 260us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966715.687949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783966715.688017:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6545:1870624587778432:0@lo:502: 00000020:01000004:0.0:1783966715.688077:0:6545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783966715.688090:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005a36d845) 00000020:00000080:0.0:1783966715.688106:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783966715.688290:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000683e0251 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783966715.688299:0:6545:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000683e0251 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783966715.688302:0:6545:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000683e0251 4 00010000:00080000:0.0:1783966715.688326:0:6545:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000db13e4c0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783966715.696254:0:6545:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1783966715.697516:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783966715.697636:0:6545:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783966715.697649:0:6545:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9269c8b3160669c3 00000100:00080000:0.0:1783966715.697659:0:6545:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783966715.697665:0:6545:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000db13e4c0 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966715.697883:0:6545:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000071a797eb x1870624587778560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783966715.697937:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587778560:0@lo:38: 00000100:00100000:1.0:1783966715.698011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783966715.698608:0:6545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783966715.698944:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778560 00000100:00100000:3.0:1783966715.698952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778560 00000100:00100000:3.0:1783966715.698986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966715.698994:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4a9044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587778560:12345-0@lo:38: 00000100:00100000:0.0:1783966715.703383:0:6545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d95e9552 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6545:1870624587778688:0@lo:502: 00000100:00100000:0.0:1783966715.703461:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966715.703501:0:6545:0:(client.c:2702:ptlrpc_set_wait()) set 000000009afd42ea going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.706356:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778688 00000100:00100000:1.0:1783966715.706368:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778688 00000100:00100000:1.0:1783966715.706424:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783966715.706432:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c4db388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6545:x1870624587778688:12345-0@lo:502: 00000100:00100000:1.0:1783966715.706589:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c4db388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6545:x1870624587778688:12345-0@lo:502: Request processed in 158us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966715.706596:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783966715.706612:0:6545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d95e9552 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:6545:1870624587778688:0@lo:502: 00000040:00080000:0.0:1783966715.706646:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1783966715.706705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4a9044 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587778560:12345-0@lo:38: Request processed in 7710us (8694us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783966715.706714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966715.706803:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966715.706809:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000db13e4c0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783966715.706813:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783966715.706816:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000071a797eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587778560:0@lo:38: 00000020:01000000:3.0:1783966715.708058:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783966715.708086:0:6495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783966715.708105:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.708122:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783966715.708184:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783966715.708186:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783966715.708188:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966715.708189:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966715.708190:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966715.708192:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966715.708193:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783966715.708194:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783966715.708196:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966715.708197:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966715.708198:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966715.708200:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783966715.708203:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783966715.708206:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783966715.708207:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783966715.708208:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966715.708209:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966715.708210:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966715.708211:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966715.708211:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783966715.708212:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783966715.708213:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966715.708214:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966715.708215:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966715.708216:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783966715.708235:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783966715.708250:0:6495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778816:0@lo:253: 00000100:00100000:3.0:1783966715.708298:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.708339:0:6495:0:(client.c:2702:ptlrpc_set_wait()) set 000000000e315855 going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.708389:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778816 00000100:00100000:1.0:1783966715.708400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778816 00000100:00100000:1.0:1783966715.708441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783966715.708447:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070a048f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778816:12345-0@lo:253: 20000000:01000000:1.0:1783966715.708469:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783966715.708481:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783966715.725719:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783966715.725746:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783966715.726132:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783966715.726138:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783966715.726159:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.726188:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.726195:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.726233:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966715.726247:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.726261:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000227eec47 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587778944:0@lo:104: 00000100:00100000:2.0:1783966715.726322:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966715.726382:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6198295 going to sleep for 11 seconds 00000100:00100000:1.0:1783966715.726994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070a048f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:6495:x1870624587778816:12345-0@lo:253: Request processed in 18545us (18693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966715.727005:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783966715.727276:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587778944 00000100:00100000:0.0:1783966715.727284:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587778944 00000100:00100000:0.0:1783966715.727321:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783966715.727328:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ddc6e75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587778944:12345-0@lo:104: 00010000:00010000:0.0:1783966715.727340:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966715.727397:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783966715.727402:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ddc6e75 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587778944:12345-0@lo:104: Request processed in 75us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966715.727430:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783966715.727537:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966715.727542:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.727559:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a72d0536 already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966715.727561:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.727568:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966715.727574:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966715.727578:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966715.727614:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.727621:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966715.727635:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.727641:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066999 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.727659:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966715.727660:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966715.727661:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966715.727686:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000227eec47 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587778944:0@lo:104: 00010000:00010000:3.0:1783966715.727705:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966715.731420:0:6495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197b021b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:6495:1870624587778816:0@lo:253: 10000000:01000000:2.0:1783966715.731442:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783966715.731446:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783966715.731447:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783966715.731449:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966715.731450:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966715.731451:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966715.731452:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966715.731453:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966715.731454:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783966715.731455:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966715.731457:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966715.731458:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966715.731459:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783966715.731473:0:6495:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783966715.732716:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000069b61013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587779072:0@lo:103: 00000100:00100000:1.0:1783966715.732815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966715.732958:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779072 00000100:00100000:3.0:1783966715.732980:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779072 00010000:00010000:3.0:1783966715.733012:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966715.733051:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966715.733060:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000252b0995 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+12:3646:x1870624587779072:12345-0@lo:103: 00010000:00010000:3.0:1783966715.733076:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966715.733080:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733091:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733107:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a679dffe/0x9269c8b316066999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066992 expref: 12 pid: 6511 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733123:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733131:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783966715.733146:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007008723s 00010000:00010000:3.0:1783966715.733150:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733156:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733161:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733178:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733184:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037c4d047 already unused, calling callback (000000005001ecdc) 00010000:00010000:3.0:1783966715.733187:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733195:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733210:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733220:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966715.733258:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000252b0995 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+11:3646:x1870624587779072:12345-0@lo:103: Request processed in 199us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966715.733266:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783966715.733289:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733296:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966715.733301:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037c4d047/0x9269c8b3160669ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966715.733876:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000069b61013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587779072:0@lo:103: 00080000:10000000:2.0:1783966715.742384:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.743174:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783966715.743655:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.744150:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783966715.744355:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.748273:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1783966715.750341:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.750536:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783966715.750757:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.751451:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783966715.751668:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1783966715.752155:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1783966715.761660:0:6495:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783966715.781833:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1783966715.781984:0:6550:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1783966715.781989:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783966715.787026:0:6551:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:0.0:1783966715.793309:0:6551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1783966715.802113:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783966715.802232:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783966715.802662:0:6495:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783966715.802669:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783966715.802765:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783966715.803839:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783966715.807964:0:6551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783966715.808060:0:6551:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783966715.808065:0:6551:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1783966715.814550:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783966715.816316:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783966715.816568:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1783966715.819082:0:6495:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1783966715.821511:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1783966715.825429:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1783966715.825842:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1783966715.825998:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1783966715.826161:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1783966715.826299:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1783966715.826456:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1783966715.826589:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1783966715.826719:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1783966715.826884:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1783966715.832461:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1783966715.833340:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1783966715.833507:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1783966715.837271:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1783966715.839564:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1783966715.840620:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1783966715.841400:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1783966715.841544:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1783966715.844192:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1783966715.846027:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1783966715.846217:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1783966715.846455:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1783966715.846574:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1783966715.846678:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1783966715.846820:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1783966715.846935:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1783966715.847078:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1783966715.848111:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1783966715.848534:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1783966715.848730:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1783966715.848918:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1783966715.849080:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1783966715.849763:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1783966715.860830:0:6495:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783966715.860875:0:6495:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71ec1bd7988 00100000:10000000:0.0:1783966715.861106:0:6495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783966715.862823:0:6495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783966715.862839:0:6495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783966715.862859:0:6495:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783966715.862875:0:6495:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783966715.863618:0:6495:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783966715.863802:0:6495:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1783966715.980948:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966716.994377:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966718.006919:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966719.041342:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966720.057408:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783966720.872952:0:6795:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1783966720.888412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783966720.888421:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783966720.888424:0:8:0:(import.c:65:import_set_state_nolock()) 00000000db13e4c0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966720.888436:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000db13e4c0 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966720.888458:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003c7c6e24 x1870624587779328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783966720.888544:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966720.888556:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587779200:0@lo:400: 00000100:00100000:3.0:1783966720.888620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966720.888723:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779200 00000100:00100000:2.0:1783966720.888731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779200 00000100:00100000:2.0:1783966720.888799:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783966720.888808:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000226a376e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:3648:x1870624587779200:12345-0@lo:400: 00000100:00100000:2.0:1783966720.888857:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000226a376e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:3648:x1870624587779200:12345-0@lo:400: Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966720.888881:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:1.0:1783966720.889651:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783966720.889655:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05ed1cf800 from 3 10000000:01000000:1.0:1783966720.889659:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783966720.889697:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966720.889708:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966720.889718:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966720.889735:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587779456:0@lo:101: 00000100:00100000:1.0:1783966720.889784:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966720.889810:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac03b5c6 going to sleep for 11 seconds 00000100:00100000:1.0:1783966720.889871:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c7c6e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587779328:0@lo:38: 00000100:00100000:3.0:1783966720.889994:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779456 00000100:00100000:3.0:1783966720.890000:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779456 00000100:00100000:3.0:1783966720.890033:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783966720.890039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085686938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+11:6515:x1870624587779456:12345-0@lo:101: 00010000:00010000:3.0:1783966720.890048:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966720.890060:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160669d1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966720.890096:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966720.890105:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966720.890115:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e0446a8, rc 0) 00000100:00100000:3.0:1783966720.890146:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085686938 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:6515:x1870624587779456:12345-0@lo:101: Request processed in 108us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966720.890629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783966720.890682:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587779200:0@lo:400: 00000100:00100000:1.0:1783966720.890751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966720.891529:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587779456:0@lo:101: 00010000:00010000:1.0:1783966720.891559:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966720.891570:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966720.891629:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587779584:0@lo:256: 00000100:00100000:1.0:1783966720.891685:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966720.891708:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac03b5c6 going to sleep for 11 seconds 00000100:00100000:0.0:1783966720.894914:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779584 00000100:00100000:0.0:1783966720.894932:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779584 00000100:00100000:0.0:1783966720.895001:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783966720.895010:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2c15383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:6515:x1870624587779584:12345-0@lo:256: 20000000:01000000:0.0:1783966720.895034:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783966720.895050:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783966720.895053:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1783966720.895185:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2c15383 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:6515:x1870624587779584:12345-0@lo:256: Request processed in 176us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966720.895194:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783966720.895587:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587779584:0@lo:256: 10000000:01000000:1.0:1783966720.895650:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783966720.895658:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966720.895668:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966720.897421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779328 00000100:00100000:2.0:1783966720.897434:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779328 00000100:00100000:2.0:1783966720.897613:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966720.897622:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3eec83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587779328:12345-0@lo:38: 00010000:00080000:2.0:1783966720.897658:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1783966720.897708:0:6519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9269c8b3160669df 00000004:00100000:2.0:1783966720.897763:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783966720.897882:0:6519:0:(import.c:65:import_set_state_nolock()) 000000002aa70b12 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783966720.898090:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3eec83b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870624587779328:12345-0@lo:38: Request processed in 467us (7338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966720.898097:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783966720.898411:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c7c6e24 x1870624587779328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783966720.898429:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783966720.898436:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783966720.898440:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783966720.898452:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000db13e4c0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783966720.898458:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c7c6e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587779328:0@lo:38: 00010000:00010000:3.0:1783966721.082333:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783966722.029646:0:6847:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783966722.030343:0:6847:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783966722.104440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966723.128169:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966724.153177:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783966724.645442:0:6949:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966724.648753:0:6949:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783966725.174959:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966726.007804:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966726.007816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587779840:0@lo:400: 00000100:00100000:1.0:1783966726.007821:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002f955142 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587779712:0@lo:400: 00000100:00100000:2.0:1783966726.007899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966726.007976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779840 00000100:00100000:2.0:1783966726.007983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779840 00000100:00100000:2.0:1783966726.008028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966726.008035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000899fef21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587779840:12345-0@lo:400: 00000100:00100000:2.0:1783966726.008086:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000899fef21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587779840:12345-0@lo:400: Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966726.008093:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783966726.008134:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c62a16a x1870624587779840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966726.008149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587779840:0@lo:400: 00000100:00100000:1.0:1783966726.008617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966726.009048:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779712 00000100:00100000:2.0:1783966726.009055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779712 00000100:00100000:2.0:1783966726.009100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966726.009108:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6becb4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:3647:x1870624587779712:12345-0@lo:400: 00000100:00100000:2.0:1783966726.009157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6becb4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+12:3647:x1870624587779712:12345-0@lo:400: Request processed in 52us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966726.009165:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783966726.009221:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002f955142 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587779712:0@lo:400: 00010000:00010000:3.0:1783966726.200940:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966727.229851:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966728.247854:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966729.271487:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966730.299117:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966731.127055:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966731.127084:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587779968:0@lo:400: 00000100:00100000:2.0:1783966731.127182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966731.127263:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006df8d47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587780096:0@lo:400: 00000100:00100000:2.0:1783966731.127301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966731.127365:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587779968 00000100:00100000:2.0:1783966731.128836:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587779968 00000100:00100000:2.0:1783966731.129066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966731.129077:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd6db23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:3645:x1870624587779968:12345-0@lo:400: 00000100:00100000:2.0:1783966731.129185:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd6db23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:3645:x1870624587779968:12345-0@lo:400: Request processed in 110us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966731.129193:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783966731.135527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780096 00000100:00100000:3.0:1783966731.135544:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780096 00000100:00100000:3.0:1783966731.135631:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783966731.135641:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8000294 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587780096:12345-0@lo:400: 00000100:00100000:3.0:1783966731.135761:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8000294 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587780096:12345-0@lo:400: Request processed in 121us (8461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966731.135797:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783966731.136604:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006df8d47b x1870624587780096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966731.136622:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006df8d47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587780096:0@lo:400: 00000100:00100000:2.0:1783966731.136665:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587779968:0@lo:400: 00010000:00010000:2.0:1783966731.330093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966732.348670:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966733.379806:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966734.391385:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783966735.106945:0:7447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783966735.106951:0:7447:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783966735.106952:0:7447:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783966735.107115:0:7447:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004487d182 00000020:01000004:3.0:1783966735.107136:0:7447:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1783966735.107150:0:7447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783966735.107179:0:7447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000003a032085) 00000020:00000080:3.0:1783966735.107200:0:7447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783966735.185987:0:7447:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1783966735.186110:0:7447:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1783966735.228994:0:7447:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783966735.229944:0:7447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1783966735.229961:0:7447:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783966735.229980:0:7447:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b3160669ed 00000020:01000004:1.0:1783966735.229991:0:7447:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783966735.230022:0:7447:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783966735.230027:0:7447:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783966735.230034:0:7447:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1783966735.230087:0:7447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1783966735.230094:0:7447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783966735.261158:0:7447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783966735.261220:0:7447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1783966735.261225:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783966735.261228:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783966735.261229:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783966735.261231:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783966735.261232:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783966735.261233:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783966735.261234:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783966735.261236:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783966735.261237:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783966735.261239:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783966735.261241:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783966735.261245:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1783966735.261249:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783966735.261251:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783966735.261252:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783966735.261253:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783966735.261254:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783966735.261255:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783966735.261256:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783966735.261257:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783966735.261258:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783966735.261259:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783966735.261260:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783966735.261296:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783966735.261397:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d95e9552 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587780224:0@lo:253: 00000100:00100000:0.0:1783966735.261505:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966735.261708:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000985db7c7 going to sleep for 11 seconds 00000100:00100000:2.0:1783966735.262011:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780224 00000100:00100000:2.0:1783966735.262031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780224 00000100:00100000:0.0:1783966735.262215:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783966735.262226:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c7daab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587780224:12345-0@lo:253: 20000000:01000000:0.0:1783966735.262277:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783966735.262289:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1783966735.262295:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1783966735.262299:0:6511:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1783966735.262360:0:6511:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1783966735.262629:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783966735.263214:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783966735.263234:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783966735.263253:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1783966735.263269:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1783966735.263284:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1783966735.263368:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1783966735.263377:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1783966735.263390:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1783966735.263395:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1783966735.263406:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1783966735.263410:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1783966735.263420:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1783966735.263435:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1783966735.263563:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1783966735.263574:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966735.263588:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1783966735.263594:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783966735.263606:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1783966735.263610:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966735.263953:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1783966735.263965:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783966735.263983:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1783966735.263998:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1783966735.264009:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783966735.264097:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1783966735.264105:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1783966735.264127:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1783966735.264143:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1783966735.264157:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1783966735.264162:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1783966735.264189:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1783966735.264212:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1783966735.264217:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1783966735.264241:0:6511:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783966735.264249:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1783966735.265554:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1783966735.266151:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783966735.266182:0:6511:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.159@tcp for mdt 20000000:01000000:0.0:1783966735.266185:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966735.266199:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783966735.266205:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783966735.266219:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783966735.266224:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966735.266240:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783966735.266249:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1783966735.266264:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1783966735.266279:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1783966735.266412:0:6511:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1783966735.266422:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1783966735.267193:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1783966735.267490:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783966735.267510:0:6511:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.204.159@tcp for mdt 20000000:01000000:0.0:1783966735.267513:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966735.267527:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783966735.267532:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783966735.267544:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783966735.267549:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966735.267561:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783966735.267576:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1783966735.267592:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783966735.267608:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1783966735.267951:0:6511:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783966735.267956:0:6511:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783966735.267961:0:6511:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783966735.268031:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783966735.268034:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966735.268500:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966735.268535:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966735.268549:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783966735.268846:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783966735.268869:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783966735.268897:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783966735.268907:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783966735.268910:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966735.269315:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966735.269349:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966735.269366:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783966735.269572:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1783966735.269591:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1783966735.269604:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1783966735.269612:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783966735.269614:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966735.270100:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966735.270129:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966735.270142:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1783966735.270276:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1783966735.270296:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1783966735.270317:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1783966735.270407:0:6511:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783966735.270410:0:6511:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783966735.270418:0:6511:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783966735.270428:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1783966735.270913:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1783966735.271033:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783966735.287067:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783966735.287230:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287278:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066922 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287288:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b31606693e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287294:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669ae expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287300:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287369:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287388:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 12 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966735.287406:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780352:0@lo:104: 00000100:00100000:1.0:1783966735.287495:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966735.287571:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287579:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 12 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966735.287587:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ff25aba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780480:0@lo:104: 00000100:00100000:1.0:1783966735.287610:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966735.287629:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.287643:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 12 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966735.287652:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000be084f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780608:0@lo:104: 00000100:00100000:1.0:1783966735.287689:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.287700:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set 0000000019d282bd going to sleep for 11 seconds 00000100:00100000:0.0:1783966735.288694:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780352 00000100:00100000:0.0:1783966735.288708:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780352 00000100:00100000:0.0:1783966735.288762:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780480 00000100:00100000:0.0:1783966735.288805:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780480 00000100:00100000:0.0:1783966735.288824:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780608 00000100:00100000:0.0:1783966735.288827:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780608 00000100:00100000:0.0:1783966735.288843:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783966735.288851:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000910b4801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:6511:x1870624587780352:12345-0@lo:104: 00010000:00010000:0.0:1783966735.288870:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.288966:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783966735.288973:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000910b4801 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:6511:x1870624587780352:12345-0@lo:104: Request processed in 122us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.288982:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783966735.289020:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966735.289026:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d705e4fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587780480:12345-0@lo:104: 00010000:00010000:0.0:1783966735.289032:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.289069:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783966735.289074:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d705e4fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587780480:12345-0@lo:104: Request processed in 49us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.289080:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966735.289093:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783966735.289098:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070ac35c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587780608:12345-0@lo:104: 00010000:00010000:0.0:1783966735.289103:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.289128:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783966735.289132:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070ac35c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587780608:12345-0@lo:104: Request processed in 35us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.289143:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783966735.289312:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000deea6c58 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780352:0@lo:104: 00000100:00100000:2.0:1783966735.289335:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ff25aba pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780480:0@lo:104: 00000100:00100000:2.0:1783966735.289344:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000be084f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587780608:0@lo:104: 00010000:00010000:2.0:1783966735.289373:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.289874:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783966735.289881:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.289892:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008702faf4 already unused, calling callback (000000007702abdd) 10000000:00010000:2.0:1783966735.289895:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.289904:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966735.289911:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.289917:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966735.289968:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.289975:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966735.289998:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290019:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 000000008702faf4/0x9269c8b3160669ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290034:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783966735.290037:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290043:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ba4b3bb already unused, calling callback (000000007702abdd) 10000000:00010000:2.0:1783966735.290045:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290051:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966735.290057:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.290062:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966735.290075:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290082:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966735.290097:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290103:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b31606693e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066945 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290114:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966735.290122:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290128:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046376924 already unused, calling callback (000000007702abdd) 10000000:00010000:2.0:1783966735.290130:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290136:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966735.290141:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.290146:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966735.290159:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290164:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966735.290169:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290174:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 0000000046376924/0x9269c8b316066922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066929 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290189:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966735.290190:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966735.290192:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966735.290210:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587780736:0@lo:103: 00000100:00100000:2.0:1783966735.290268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.290350:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006df8d47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587780864:0@lo:103: 00000100:00100000:2.0:1783966735.290383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.290400:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966735.290404:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587780992:0@lo:103: 00000100:00100000:2.0:1783966735.290422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.290461:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780736 00000100:00100000:2.0:1783966735.290468:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780736 00010000:00010000:2.0:1783966735.290497:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 13 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.290518:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780864 00000100:00100000:2.0:1783966735.290520:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780864 00010000:00010000:2.0:1783966735.290529:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 14 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.290537:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587780992 00000100:00100000:2.0:1783966735.290540:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587780992 00010000:00010000:2.0:1783966735.290548:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 15 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.290562:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966735.290569:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b50af6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+15:3648:x1870624587780736:12345-0@lo:103: 00010000:00010000:2.0:1783966735.290581:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966735.290586:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 15 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290596:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 15 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290611:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c140b1ef/0x9269c8b3160669b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160669ae expref: 15 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290640:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966735.290680:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b50af6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+14:3648:x1870624587780736:12345-0@lo:103: Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.290688:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966735.290704:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783966735.290710:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f27256b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+13:3645:x1870624587780864:12345-0@lo:103: 00010000:00010000:2.0:1783966735.290718:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966735.290721:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 13 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290728:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 13 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290737:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7e79755/0x9269c8b316066945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b31606693e expref: 13 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290747:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966735.290798:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f27256b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+12:3645:x1870624587780864:12345-0@lo:103: Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.290804:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783966735.290816:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783966735.290822:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d42c9a09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+11:3645:x1870624587780992:12345-0@lo:103: 00010000:00010000:2.0:1783966735.290829:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966735.290833:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 11 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290840:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 11 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290856:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a8c2187/0x9269c8b316066929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066922 expref: 11 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290868:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290875:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290890:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290895:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290901:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290907:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290912:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000175cb25f already unused, calling callback (000000005001ecdc) 00010000:00010000:2.0:1783966735.290915:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290921:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290933:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.290952:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966735.290973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d42c9a09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+10:3645:x1870624587780992:12345-0@lo:103: Request processed in 152us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.290979:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783966735.291010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587780992:0@lo:103: 00000100:00100000:2.0:1783966735.291017:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006df8d47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587780864:0@lo:103: 00000100:00100000:2.0:1783966735.291047:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587780736:0@lo:103: 00010000:00010000:2.0:1783966735.291060:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.291068:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.291073:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000175cb25f/0x9269c8b3160669f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783966735.291090:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1783966735.292256:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966735.296651:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c7daab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+9:7447:x1870624587780224:12345-0@lo:253: Request processed in 34405us (35125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.296684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966735.296950:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d95e9552 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587780224:0@lo:253: 10000000:01000000:2.0:1783966735.296970:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783966735.296974:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783966735.296976:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783966735.296978:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966735.296979:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1783966735.296981:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966735.296982:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966735.296983:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966735.296985:0:7447:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783966735.296987:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966735.297008:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783966735.297033:0:7447:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004487d182 from lustre-MDT0001 10000000:01000000:2.0:1783966735.297077:0:7447:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1783966735.297081:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783966735.297089:0:7447:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 10000000:01000000:2.0:1783966735.297094:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783966735.297246:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.297258:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.297269:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.297296:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781120:0@lo:101: 00000100:00100000:2.0:1783966735.297428:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.297526:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000378b4dab going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.297570:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781120 00000100:00100000:1.0:1783966735.297579:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781120 00000100:00100000:1.0:1783966735.297739:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783966735.297752:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc3e8aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+9:7447:x1870624587781120:12345-0@lo:101: 00010000:00010000:1.0:1783966735.297808:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966735.297829:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ee01192/0x9269c8b316066a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160669fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.297861:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ee01192/0x9269c8b316066a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160669fb expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.297874:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ee01192/0x9269c8b316066a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669fb expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.297886:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ee01192, rc 0) 00000100:00100000:1.0:1783966735.297931:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc3e8aa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+10:7447:x1870624587781120:12345-0@lo:101: Request processed in 182us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.297939:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966735.298033:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781120:0@lo:101: 00010000:00010000:2.0:1783966735.298049:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.298060:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.298191:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781248:0@lo:501: 00000100:00100000:2.0:1783966735.298220:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.298533:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000378b4dab going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.298598:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781248 00000100:00100000:3.0:1783966735.298604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781248 00000100:00100000:3.0:1783966735.298715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966735.298723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7748f84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+10:7447:x1870624587781248:12345-0@lo:501: 00000100:00100000:3.0:1783966735.298835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7748f84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+10:7447:x1870624587781248:12345-0@lo:501: Request processed in 113us (615us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783966735.298843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783966735.298929:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781248:0@lo:501: 10000000:01000000:2.0:1783966735.298946:0:7447:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783966735.298983:0:7447:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783966735.298989:0:7447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.298999:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299006:0:7447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299035:0:7447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783966735.299069:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05f1a14000 10000000:01000000:2.0:1783966735.299075:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783966735.299081:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a05c3468000 10000000:01000000:2.0:1783966735.299084:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783966735.299087:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a05c3468000 from 1 10000000:01000000:2.0:1783966735.299090:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783966735.299114:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299121:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299129:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.299143:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781376:0@lo:101: 00000100:00100000:2.0:1783966735.299172:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.299194:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.299237:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781376 00000100:00100000:3.0:1783966735.299261:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781376 00000100:00100000:3.0:1783966735.299280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783966735.299286:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018ef671d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+10:7447:x1870624587781376:12345-0@lo:101: 00010000:00010000:3.0:1783966735.299293:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966735.299306:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9b68850/0x9269c8b316066a10 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a09 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.299539:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9b68850/0x9269c8b316066a10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a09 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.299552:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9b68850/0x9269c8b316066a10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a09 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.299560:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9b68850, rc 0) 00000100:00100000:3.0:1783966735.299604:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018ef671d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+11:7447:x1870624587781376:12345-0@lo:101: Request processed in 319us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.299611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783966735.299737:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781376:0@lo:101: 00010000:00010000:2.0:1783966735.299758:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299794:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.299819:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783966735.299830:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299838:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000f931c6a9/0x9269c8b316066a09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.299847:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a05f1a14000 10000000:01000000:2.0:1783966735.299864:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783966735.299869:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a05f1a14000 from 1 10000000:01000000:2.0:1783966735.299871:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783966735.299887:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299894:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.299901:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.299913:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781504:0@lo:101: 00000100:00100000:2.0:1783966735.299943:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966735.299989:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966735.300004:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300013:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9b5239e already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966735.300017:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300027:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966735.300032:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966735.300038:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966735.300058:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300064:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966735.300084:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300091:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000c9b5239e/0x9269c8b3160669fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066a02 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300110:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966735.300112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966735.300114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966735.300125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587781632:0@lo:103: 00000100:00100000:3.0:1783966735.300172:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.300223:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781632 00000100:00100000:3.0:1783966735.300228:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781632 00000100:00100000:3.0:1783966735.300273:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966735.300279:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5e3ccfe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+11:3647:x1870624587781632:12345-0@lo:103: 00010000:00010000:3.0:1783966735.300290:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966735.300303:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ee01192/0x9269c8b316066a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160669fb expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.300315:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966735.300352:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5e3ccfe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+10:3647:x1870624587781632:12345-0@lo:103: Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.300359:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966735.300381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587781632:0@lo:103: 00000100:00100000:2.0:1783966735.301026:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.301110:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781504 00000100:00100000:1.0:1783966735.301117:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781504 00000100:00100000:1.0:1783966735.301153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966735.301172:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040310a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+10:7447:x1870624587781504:12345-0@lo:101: 00010000:00010000:1.0:1783966735.301186:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966735.301201:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ebe3b56a/0x9269c8b316066a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a17 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ebe3b56a/0x9269c8b316066a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a17 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301231:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ebe3b56a/0x9269c8b316066a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a17 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301239:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ebe3b56a, rc 0) 00000100:00100000:1.0:1783966735.301285:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040310a7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+11:7447:x1870624587781504:12345-0@lo:101: Request processed in 116us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.301291:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783966735.301439:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781504:0@lo:101: 00010000:00010000:2.0:1783966735.301459:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.301467:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.301482:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783966735.301499:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.301506:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000a72d0536/0x9269c8b316066a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966735.301513:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1783966735.301517:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783966735.301522:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a05f1a14000 10000000:01000000:2.0:1783966735.301525:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783966735.301528:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1783966735.301531:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1783966735.301552:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.301559:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.301565:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.301581:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781760:0@lo:101: 00000100:00100000:2.0:1783966735.301611:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.301631:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.301738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781760 00000100:00100000:1.0:1783966735.301742:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781760 00000100:00100000:1.0:1783966735.301761:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783966735.301766:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c842e2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+11:7447:x1870624587781760:12345-0@lo:101: 00010000:00010000:1.0:1783966735.301794:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966735.301802:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa7fea22/0x9269c8b316066a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a25 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301814:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa7fea22/0x9269c8b316066a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a25 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301820:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa7fea22/0x9269c8b316066a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a25 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.301826:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa7fea22, rc 0) 00000100:00100000:1.0:1783966735.301855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c842e2fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587781760:12345-0@lo:101: Request processed in 90us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.301861:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783966735.301946:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781760:0@lo:101: 00010000:00010000:2.0:1783966735.301954:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.301960:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966735.302062:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781888:0@lo:501: 00000100:00100000:2.0:1783966735.302085:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.302101:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.302149:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587781888 00000100:00100000:1.0:1783966735.302153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587781888 00000100:00100000:1.0:1783966735.302169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783966735.302174:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e76672e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587781888:12345-0@lo:501: 00000100:00100000:1.0:1783966735.302305:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e76672e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587781888:12345-0@lo:501: Request processed in 130us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.302312:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783966735.302437:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587781888:0@lo:501: 00000100:00100000:2.0:1783966735.302465:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782016:0@lo:503: 00000100:00100000:2.0:1783966735.302505:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.302522:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.302563:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782016 00000100:00100000:1.0:1783966735.302567:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782016 00000100:00100000:1.0:1783966735.302585:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783966735.302589:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e100e700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782016:12345-0@lo:503: 00000100:00100000:1.0:1783966735.302695:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e100e700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782016:12345-0@lo:503: Request processed in 106us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.302702:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783966735.302908:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782016:0@lo:503: 00000040:00080000:2.0:1783966735.303238:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783966735.303318:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782144:0@lo:502: 00000100:00100000:2.0:1783966735.303701:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.303730:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.303901:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782144 00000100:00100000:1.0:1783966735.303907:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782144 00000100:00100000:1.0:1783966735.303940:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783966735.303947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd7d0836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782144:12345-0@lo:502: 00000100:00100000:1.0:1783966735.304062:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd7d0836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782144:12345-0@lo:502: Request processed in 116us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.304071:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783966735.304249:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782144:0@lo:502: 00000040:00080000:2.0:1783966735.304600:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783966735.304703:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1783966735.304723:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1783966735.304738:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1783966735.304752:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1783966735.304764:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1783966735.304830:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1783966735.304844:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1783966735.304858:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1783966735.304870:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1783966735.304882:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1783966735.304895:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1783966735.304907:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1783966735.304919:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1783966735.304931:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1783966735.304946:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1783966735.304959:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1783966735.304971:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1783966735.304983:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1783966735.304995:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1783966735.305007:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1783966735.305029:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1783966735.305043:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1783966735.305077:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782272:0@lo:502: 00000100:00100000:2.0:1783966735.305130:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.305160:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020fad71c going to sleep for 11 seconds 00000100:00100000:0.0:1783966735.305245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782272 00000100:00100000:0.0:1783966735.305252:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782272 00000100:00100000:0.0:1783966735.305293:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783966735.305300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a84f213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782272:12345-0@lo:502: 00000100:00100000:0.0:1783966735.305492:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a84f213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782272:12345-0@lo:502: Request processed in 192us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.305500:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783966735.305712:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782272:0@lo:502: 00000040:00080000:2.0:1783966735.310062:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1783966735.310114:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1783966735.313041:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966735.313063:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.313067:0:7459:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783966735.313077:0:7459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783966735.313087:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783966735.313109:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000ad12fae2) 00000020:00000080:1.0:1783966735.313143:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1783966735.313150:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783966735.313256:0:7459:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783966735.313265:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316066a3a 00000020:00000080:1.0:1783966735.313726:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783966735.313732:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966735.313737:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.313738:0:7459:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783966735.313741:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966735.313746:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.313747:0:7459:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783966735.313750:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783966735.313761:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000148bd293) 00000020:00000080:1.0:1783966735.314005:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1783966735.314013:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783966735.314014:0:7459:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783966735.314018:0:7459:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783966735.314025:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783966735.314082:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004487d182 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783966735.314104:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000054b703a9) 00000020:00000080:1.0:1783966735.314113:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1783966735.314201:0:7459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783966735.314207:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066a4f 00000020:00000080:1.0:1783966735.314523:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783966735.314531:0:7459:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783966735.314537:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9269c8b316066a56 00080000:01000000:1.0:1783966735.314543:0:7459:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783966735.314547:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316066a5d 00080000:10000000:1.0:1783966735.315209:0:7459:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1783966735.315887:0:7459:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1783966735.415110:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966735.431068:0:7459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1783966735.431419:0:7459:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1783966735.434854:0:7459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783966735.437995:0:7459:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783966735.460270:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783966735.460293:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966735.460301:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966735.460303:0:7459:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783966735.460308:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966735.460315:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966735.460316:0:7459:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783966735.460387:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783966735.460394:0:7459:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:0.0:1783966735.460431:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783966735.460450:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000818ad4e7) 00000020:00000080:0.0:1783966735.460480:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1783966735.460486:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783966735.460575:0:7459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783966735.460583:0:7459:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783966735.460593:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316066a6b 00010000:00080000:0.0:1783966735.460648:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000055644eea@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783966735.470225:0:7459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1783966735.474519:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783966735.474542:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783966735.474595:0:7459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783966735.475084:0:7459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066a72 00000100:00080000:1.0:1783966735.475099:0:7459:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783966735.475106:0:7459:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000055644eea using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783966735.475156:0:7459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f5cb1ed0 x1870624587782400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783966735.475185:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1783966735.475264:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966735.475269:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475271:0:7459:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783966735.475274:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783966735.475278:0:7459:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783966735.475279:0:7459:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783966735.475281:0:7459:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783966735.475282:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783966735.475284:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475285:0:7459:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783966735.475288:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966735.475292:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475294:0:7459:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1783966735.475297:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783966735.475425:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5cb1ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587782400:0@lo:38: 00000100:00100000:2.0:1783966735.475501:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587782528:0@lo:400: 00000100:00100000:0.0:1783966735.475523:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.475547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1783966735.475701:0:7459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1783966735.475709:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782528 00000020:01000000:1.0:1783966735.475719:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966735.475722:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475724:0:7459:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1783966735.475726:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966735.475729:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475730:0:7459:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000100:00100000:2.0:1783966735.475732:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782528 00000020:00000080:1.0:1783966735.475732:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783966735.475733:0:7459:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783966735.475805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000000:1.0:1783966735.475806:0:7459:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966735.475810:0:7459:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966735.475811:0:7459:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000100:00100000:2.0:1783966735.475814:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006df8d47b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587782528:12345-0@lo:400: 00000040:00080000:1.0:1783966735.475814:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1783966735.475874:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006df8d47b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587782528:12345-0@lo:400: Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.475881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783966735.475920:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c62a16a x1870624587782528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966735.475935:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587782528:0@lo:400: 00000100:00100000:2.0:1783966735.476105:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782400 00000100:00100000:2.0:1783966735.476110:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782400 00000100:00100000:2.0:1783966735.476136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966735.476140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb9b2cff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587782400:12345-0@lo:38: 00010000:00080000:2.0:1783966735.476162:0:6522:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1783966735.476211:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066a79 00000004:00100000:2.0:1783966735.476229:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783966735.476236:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1783966735.476241:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1783966735.476283:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1783966735.476298:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.476309:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000f3d6b905/0x9269c8b316066a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966735.476318:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05f1a14000 from 1 10000000:01000000:0.0:1783966735.476332:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783966735.476364:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.476371:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.476380:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966735.476395:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782656:0@lo:101: 00000100:00100000:0.0:1783966735.476433:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966735.476464:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aeac4ac3 going to sleep for 11 seconds 00000100:00100000:2.0:1783966735.476737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782656 00000100:00100000:2.0:1783966735.476742:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782656 00000100:00100000:2.0:1783966735.476804:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783966735.476813:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004b775e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+12:7447:x1870624587782656:12345-0@lo:101: 00010000:00010000:2.0:1783966735.476824:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966735.476841:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a80 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.476937:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a80 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.476951:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a80 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.476960:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046376924, rc 0) 00000100:00100000:3.0:1783966735.477014:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004b775e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+13:7447:x1870624587782656:12345-0@lo:101: Request processed in 203us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.477021:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783966735.477152:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782656:0@lo:101: 00010000:00010000:0.0:1783966735.477167:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.477176:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966735.478712:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782784:0@lo:256: 00000100:00100000:0.0:1783966735.478829:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966735.478879:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aeac4ac3 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.479076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782784 00000100:00100000:3.0:1783966735.479084:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782784 00000100:00100000:3.0:1783966735.479138:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783966735.479147:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb13e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+13:7447:x1870624587782784:12345-0@lo:256: 20000000:01000000:3.0:1783966735.479171:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783966735.479195:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783966735.479199:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783966735.479311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb13e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+13:7447:x1870624587782784:12345-0@lo:256: Request processed in 164us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.479464:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782784:0@lo:256: 00000100:00100000:3.0:1783966735.479691:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 10000000:01000000:0.0:1783966735.482395:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783966735.482478:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.482497:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966735.482506:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f1a14000 from 1 10000000:01000000:0.0:1783966735.482510:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966735.482569:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.482576:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966735.482587:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966735.482629:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782912:0@lo:101: 00000100:00100000:0.0:1783966735.482732:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966735.482806:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aeac4ac3 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.482965:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587782912 00000100:00100000:3.0:1783966735.482975:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587782912 00000100:00100000:3.0:1783966735.483081:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783966735.483091:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0907f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+13:7447:x1870624587782912:12345-0@lo:101: 00010000:00010000:3.0:1783966735.483108:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966735.483123:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a8e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.483152:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a8e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.483164:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a8e expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.483175:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a679dffe, rc 0) 00000100:00100000:3.0:1783966735.483230:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0907f3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587782912:12345-0@lo:101: Request processed in 140us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.483238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783966735.483299:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000086d6b5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587782912:0@lo:101: 00010000:00010000:3.0:1783966735.483314:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.483580:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966735.483808:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783040:0@lo:501: 00000100:00100000:3.0:1783966735.483858:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.483884:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d422cd66 going to sleep for 11 seconds 00000100:00100000:0.0:1783966735.483942:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783040 00000100:00100000:0.0:1783966735.483948:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783040 00000100:00100000:0.0:1783966735.483999:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783966735.484006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b892b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587783040:12345-0@lo:501: 00000100:00100000:0.0:1783966735.484119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b892b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587783040:12345-0@lo:501: Request processed in 115us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.484128:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783966735.484253:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783040:0@lo:501: 00000100:00100000:3.0:1783966735.484285:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783168:0@lo:503: 00000100:00100000:3.0:1783966735.484454:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.484478:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d422cd66 going to sleep for 11 seconds 00000100:00100000:2.0:1783966735.484733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783168 00000100:00100000:2.0:1783966735.484740:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783168 00000100:00100000:2.0:1783966735.484862:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783966735.484871:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a89444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587783168:12345-0@lo:503: 00000040:00080000:2.0:1783966735.484911:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783966735.484965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a89444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587783168:12345-0@lo:503: Request processed in 97us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.484972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783966735.485186:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783168:0@lo:503: 00000040:00080000:3.0:1783966735.485966:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966735.486966:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1783966735.487194:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966735.490948:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1783966735.491301:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783966735.491402:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966735.491461:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.491477:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966735.491551:0:7447:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783966735.491555:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05f1a14000 10000000:01000000:3.0:1783966735.491558:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05f1a14000 10000000:01000000:3.0:1783966735.491563:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783966735.491571:0:7447:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f1a14000 from 1 10000000:01000000:3.0:1783966735.491573:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966735.491757:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.491766:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.491828:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966735.491856:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783296:0@lo:101: 00000100:00100000:3.0:1783966735.491943:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.492055:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783296 00000100:00100000:2.0:1783966735.492065:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783296 00000100:00100000:2.0:1783966735.492117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966735.492126:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf79248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:7447:x1870624587783296:12345-0@lo:101: 00010000:00010000:2.0:1783966735.492144:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966735.492161:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008702faf4/0x9269c8b316066aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066a9c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.492190:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008702faf4/0x9269c8b316066aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066a9c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.492200:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008702faf4/0x9269c8b316066aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a9c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.492208:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008702faf4, rc 0) 00000100:00100000:2.0:1783966735.492246:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf79248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783296:12345-0@lo:101: Request processed in 121us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.492253:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783966735.492442:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff0fb4fc going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.492468:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783296:0@lo:101: 00010000:00010000:3.0:1783966735.492483:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.492491:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966735.492591:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783424:0@lo:501: 00000100:00100000:3.0:1783966735.492753:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.492793:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff0fb4fc going to sleep for 11 seconds 00000100:00100000:0.0:1783966735.492939:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783424 00000100:00100000:0.0:1783966735.492945:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783424 00000100:00100000:0.0:1783966735.493203:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783966735.493212:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5bab97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783424:12345-0@lo:501: 00000100:00100000:0.0:1783966735.493347:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5bab97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783424:12345-0@lo:501: Request processed in 137us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.493356:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783966735.493813:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783424:0@lo:501: 00000100:00100000:3.0:1783966735.493861:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783552:0@lo:503: 00000100:00100000:3.0:1783966735.493920:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.493954:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff0fb4fc going to sleep for 11 seconds 00000100:00080000:3.0:1783966735.494804:0:6522:0:(import.c:65:import_set_state_nolock()) 000000006358d0cb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966735.494938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb9b2cff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587782400:12345-0@lo:38: Request processed in 18794us (19413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.494958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966735.494980:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783552 00000100:00100000:2.0:1783966735.494987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783552 00000100:00100000:2.0:1783966735.495036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783966735.495045:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000892ddd1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783552:12345-0@lo:503: 00000100:00100000:2.0:1783966735.495213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000892ddd1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783552:12345-0@lo:503: Request processed in 170us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966735.495226:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783966735.495245:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783966735.495255:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1783966735.495264:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783966735.495270:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:2.0:1783966735.495272:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d960e577 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783552:0@lo:503: 00000100:00080000:0.0:1783966735.495273:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000055644eea lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783966735.495343:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5cb1ed0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587782400:0@lo:38: 00000100:00100000:0.0:1783966735.495558:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002e914a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587783680:0@lo:41: 00000100:00100000:0.0:1783966735.495597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.495901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783680 00000100:00100000:1.0:1783966735.495908:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783680 00000100:00100000:1.0:1783966735.495993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966735.496000:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e8fce4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587783680:12345-0@lo:41: 00000004:00000024:1.0:1783966735.496031:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1783966735.496178:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e8fce4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587783680:12345-0@lo:41: Request processed in 179us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.496186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783966735.496239:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002e914a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587783680:0@lo:41: 00000040:00080000:2.0:1783966735.496459:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783966735.496537:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783808:0@lo:502: 00000100:00100000:2.0:1783966735.496593:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.496627:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a4b8c87 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.496801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783808 00000100:00100000:3.0:1783966735.496806:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783808 00000100:00100000:3.0:1783966735.496850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783966735.496856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002968e6df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783808:12345-0@lo:502: 00000100:00100000:3.0:1783966735.496955:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002968e6df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783808:12345-0@lo:502: Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.496961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783966735.497075:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783808:0@lo:502: 00000040:00080000:2.0:1783966735.497278:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783966735.497320:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783966735.497336:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783966735.497349:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783966735.497360:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783966735.497373:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783966735.497386:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783966735.497400:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783966735.497413:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783966735.497426:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783966735.497438:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783966735.497451:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783966735.497462:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783966735.497474:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783966735.497486:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783966735.497496:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783966735.497508:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783966735.497534:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783966735.497565:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783966735.497586:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783966735.497599:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783966735.497610:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783966735.497713:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783966735.497728:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783966735.497741:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783966735.497754:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783966735.497798:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783966735.497816:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1783966735.497848:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783936:0@lo:502: 00000100:00100000:2.0:1783966735.497896:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.497933:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a4b8c87 going to sleep for 11 seconds 00000100:00100000:0.0:1783966735.498027:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587783936 00000100:00100000:0.0:1783966735.498034:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587783936 00000100:00100000:0.0:1783966735.498083:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783966735.498091:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdb84ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783936:12345-0@lo:502: 00000100:00100000:0.0:1783966735.498206:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdb84ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587783936:12345-0@lo:502: Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.498219:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783966735.498251:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c62a16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587783936:0@lo:502: 00000040:00080000:1.0:1783966735.498300:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1783966735.498309:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1783966735.499077:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783966735.499096:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000009a390649) 00000020:00000080:1.0:1783966735.499120:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1783966735.499336:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004487d182 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783966735.499341:0:7465:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004487d182 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783966735.499344:0:7465:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004487d182 3 00010000:00080000:1.0:1783966735.499377:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000614b54d3@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783966735.510371:0:7465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1783966735.510515:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1783966735.510589:0:7465:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783966735.510606:0:7465:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9269c8b316066ab1 00000100:00080000:3.0:1783966735.511534:0:7465:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783966735.511544:0:7465:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000614b54d3 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966735.511601:0:7465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d646b9a5 x1870624587784064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783966735.511882:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783966735.513424:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d646b9a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587784064:0@lo:38: 00000100:00100000:1.0:1783966735.513558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.513945:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784064 00000100:00100000:3.0:1783966735.513956:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784064 00000100:00100000:3.0:1783966735.514004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783966735.514012:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000062a17e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587784064:12345-0@lo:38: 00010000:00080000:3.0:1783966735.514046:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1783966735.514096:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9269c8b316066ab8 00000004:00100000:3.0:1783966735.514116:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783966735.514158:0:6517:0:(import.c:65:import_set_state_nolock()) 0000000067c9acab : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966735.514227:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000062a17e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870624587784064:12345-0@lo:38: Request processed in 214us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.514234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1783966735.514379:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783966735.514606:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783966735.514653:0:7447:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783966735.514682:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966735.514694:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000066df7e7f/0x9269c8b316066a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783966735.514756:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783966735.514759:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783966735.514761:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966735.514762:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966735.514763:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966735.514765:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966735.514766:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966735.514797:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966735.514799:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966735.514800:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966735.514802:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783966735.514806:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1783966735.514809:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783966735.514810:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783966735.514811:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966735.514812:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966735.514813:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966735.514820:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966735.514821:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966735.514821:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966735.514822:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966735.514823:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966735.514824:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783966735.514849:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783966735.514868:0:7447:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587784192:0@lo:253: 00000100:00100000:2.0:1783966735.514920:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.514955:0:7447:0:(client.c:2702:ptlrpc_set_wait()) set 000000002a4b8c87 going to sleep for 11 seconds 00010000:00080000:1.0:1783966735.515428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d646b9a5 x1870624587784064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966735.515443:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966735.515453:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783966735.515471:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783966735.515476:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783966735.515479:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000614b54d3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783966735.515486:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d646b9a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587784064:0@lo:38: 40000000:00080000:1.0:1783966735.515578:0:7467:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1783966735.515849:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784192 00000100:00100000:1.0:1783966735.515858:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784192 00000100:00100000:1.0:1783966735.515908:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783966735.515916:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a96452ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587784192:12345-0@lo:253: 20000000:01000000:1.0:1783966735.515947:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783966735.515968:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783966735.517884:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783966735.518292:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783966735.518340:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783966735.519066:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a96452ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7447:x1870624587784192:12345-0@lo:253: Request processed in 3145us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966735.519085:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 20000000:01000000:3.0:1783966735.519200:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783966735.519223:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783966735.519249:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519267:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519274:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a80 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519281:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519340:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519358:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 14 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966735.519373:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058ce17a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587784320:0@lo:104: 00000100:00100000:3.0:1783966735.519415:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966735.519455:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519462:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966735.519469:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587784448:0@lo:104: 00000100:00100000:3.0:1783966735.519486:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.519502:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set 0000000051221ef0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.519533:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784320 00000100:00100000:3.0:1783966735.519679:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784320 00000100:00100000:3.0:1783966735.519717:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784448 00000100:00100000:3.0:1783966735.519719:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784448 00000100:00100000:3.0:1783966735.519731:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966735.519738:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a58941cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587784320:12345-0@lo:104: 00010000:00010000:3.0:1783966735.519750:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519821:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966735.519826:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a58941cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587784320:12345-0@lo:104: Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.519832:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966735.519845:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966735.519849:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041add946 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587784448:12345-0@lo:104: 00010000:00010000:3.0:1783966735.519855:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519889:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783966735.519893:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041add946 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587784448:12345-0@lo:104: Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.519899:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1783966735.519928:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783966735.519935:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519944:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000134b87a9 already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966735.519948:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.519968:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966735.519975:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966735.519981:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966735.520012:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520018:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966735.520039:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520045:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000134b87a9/0x9269c8b316066a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a87 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520060:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966735.520062:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520067:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d37307e7 already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966735.520069:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520074:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966735.520078:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966735.520090:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966735.520102:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520108:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966735.520120:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520126:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000d37307e7/0x9269c8b3160669d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966735.520140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966735.520142:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966735.520143:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966735.520261:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966735.520275:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587784576:0@lo:103: 00000100:00100000:3.0:1783966735.520309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.520435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f884b42d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587784704:0@lo:103: 00000100:00100000:2.0:1783966735.520505:0:7447:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:7447:1870624587784192:0@lo:253: 10000000:01000000:2.0:1783966735.520522:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783966735.520527:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783966735.520529:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783966735.520530:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966735.520532:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966735.520533:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966735.520534:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966735.520536:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783966735.520537:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966735.520539:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966735.520553:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966735.520555:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783966735.520574:0:7447:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1783966735.524263:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058ce17a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587784320:0@lo:104: 00000100:00100000:3.0:1783966735.524286:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587784448:0@lo:104: 00010000:00010000:3.0:1783966735.524326:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.524820:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966735.524850:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784576 00000100:00100000:1.0:1783966735.524860:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784576 00010000:00010000:1.0:1783966735.524917:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 15 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966735.524961:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783966735.524971:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cceb0cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+15:3645:x1870624587784576:12345-0@lo:103: 00010000:00010000:1.0:1783966735.524991:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966735.524996:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 15 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.525008:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 15 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.525031:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046376924/0x9269c8b316066a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066a80 expref: 15 pid: 6511 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.525075:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966735.525182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cceb0cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+14:3645:x1870624587784576:12345-0@lo:103: Request processed in 212us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.525190:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783966735.525326:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587784576:0@lo:103: 00000100:00100000:0.0:1783966735.528192:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.528358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784704 00000100:00100000:1.0:1783966735.528371:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784704 00010000:00010000:1.0:1783966735.528420:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966735.528473:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966735.528483:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc738a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+14:3647:x1870624587784704:12345-0@lo:103: 00010000:00010000:1.0:1783966735.528502:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966735.528509:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528522:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528669:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e0446a8/0x9269c8b3160669d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160669d1 expref: 14 pid: 6510 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528690:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528698:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783966735.528719:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009497774s 00010000:00010000:1.0:1783966735.528724:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528748:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528754:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528761:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528803:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7e79755 already unused, calling callback (000000005001ecdc) 00010000:00010000:1.0:1783966735.528808:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528817:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528834:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.528847:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966735.528924:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc738a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+13:3647:x1870624587784704:12345-0@lo:103: Request processed in 443us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.528932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966735.529020:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f884b42d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587784704:0@lo:103: 00010000:00010000:1.0:1783966735.529050:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.529058:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966735.529075:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7e79755/0x9269c8b316066abf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1783966735.531335:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1783966735.531531:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783966735.531916:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783966735.532097:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783966735.532290:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783966735.532494:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1783966735.533964:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783966735.534265:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783966735.534643:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1783966735.534845:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783966735.535020:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1783966735.535199:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1783966735.538226:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1783966735.538534:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1783966735.538633:0:7471:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087fd35b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1870624587784832:0@lo:700: 00000100:00100000:0.0:1783966735.538757:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966735.538857:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784832 00000100:00100000:0.0:1783966735.538867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784832 00000100:00100000:0.0:1783966735.538927:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783966735.538937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e48e3028 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1870624587784832:12345-0@lo:700: 00000100:00100000:0.0:1783966735.539075:0:7471:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ac2ddf0 going to sleep for 11 seconds 00000040:01000000:1.0:1783966735.539456:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783966735.539995:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587784960:0@lo:1000: 00000100:00100000:1.0:1783966735.540074:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.540105:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9328aef going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.540156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587784960 00000100:00100000:3.0:1783966735.540163:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587784960 00000100:00100000:3.0:1783966735.540212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783966735.540221:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bbfaec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587784960:12345-0@lo:1000: 00000100:00100000:3.0:1783966735.540314:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bbfaec8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587784960:12345-0@lo:1000: Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.540340:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783966735.540487:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587784960:0@lo:1000: 00000040:01000000:1.0:1783966735.540524:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1783966735.540563:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785088:0@lo:700: 00000100:00100000:1.0:1783966735.540593:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.540619:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db5a6f06 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.540727:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785088 00000100:00100000:3.0:1783966735.540733:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785088 00000100:00100000:3.0:1783966735.540799:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966735.540807:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073a4a1af pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785088:12345-0@lo:700: 00000100:00100000:3.0:1783966735.540851:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073a4a1af pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785088:12345-0@lo:700: Request processed in 46us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.540857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966735.540935:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785088:0@lo:700: 00000100:00100000:1.0:1783966735.540982:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1870624587785216:0@lo:900: 00000100:00100000:1.0:1783966735.541010:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.541034:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db5a6f06 going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.541079:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785216 00000100:00100000:3.0:1783966735.541083:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785216 00000100:00100000:3.0:1783966735.541114:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783966735.541120:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000738baaa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1870624587785216:12345-0@lo:900: 00000100:00100000:3.0:1783966735.541158:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000738baaa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1870624587785216:12345-0@lo:900: Request processed in 38us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.541164:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1783966735.542000:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1783966735.542128:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1783966735.542494:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000252b0995 x1870624587785216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783966751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966735.542511:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1870624587785216:0@lo:900: 00000100:00100000:1.0:1783966735.542629:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785344:0@lo:1000: 00000100:00100000:1.0:1783966735.542701:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.542734:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f5ef40b going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.542960:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785344 00000100:00100000:3.0:1783966735.542969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785344 00000100:00100000:3.0:1783966735.543026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783966735.543033:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206fd2a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785344:12345-0@lo:1000: 00000100:00100000:3.0:1783966735.543115:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206fd2a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785344:12345-0@lo:1000: Request processed in 82us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966735.543123:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783966735.543191:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785344:0@lo:1000: 00000004:00080000:1.0:1783966735.543245:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000db5a6f06 with version 0 00000020:00100000:1.0:1783966735.543273:0:7472:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1783966735.543279:0:7472:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000252b0995 x1870624587785600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783966735.543293:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785600:0@lo:1000: 00000100:00100000:1.0:1783966735.543399:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966735.543423:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f5ef40b going to sleep for 11 seconds 00000100:00100000:3.0:1783966735.543462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785600 00000100:00100000:3.0:1783966735.543466:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785600 00000100:00100000:3.0:1783966735.543493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966735.543498:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076985883 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785600:12345-0@lo:1000: 00000004:00000080:0.0:1783966735.544926:0:7447:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783966735.545026:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000020:00080000:2.0:1783966735.546315:0:7470:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783966735.546398:0:7470:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1783966735.547928:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783966735.548978:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783966735.549604:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783966735.549652:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783966735.551465:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783966735.552233:0:7447:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783966735.553691:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1783966735.554160:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1783966735.554287:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1783966735.554506:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1783966735.554750:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1783966735.555260:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1783966735.555405:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1783966735.555763:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1783966735.556006:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1783966735.556324:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1783966735.556476:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1783966735.556987:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1783966735.557307:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1783966735.557440:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1783966735.558029:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1783966735.558188:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1783966735.558498:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1783966735.558677:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1783966735.558860:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1783966735.559005:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1783966735.559155:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1783966735.559301:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783966735.559445:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1783966735.559591:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783966735.564275:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783966735.564523:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000001:00080000:3.0:1783966735.566653:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:0.0:1783966735.567197:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783966735.567451:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783966735.567731:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783966735.567897:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783966735.568020:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783966735.568166:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783966735.568376:0:7447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1783966735.571194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076985883 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785600:12345-0@lo:1000: Request processed in 27682us (27862us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783966735.571218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1783966735.571917:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1783966735.571926:0:7472:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783966735.571950:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785600:0@lo:1000: 00000100:00100000:2.0:1783966735.572069:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785728:0@lo:1000: 00000100:00100000:2.0:1783966735.572123:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966735.572184:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d578f979 going to sleep for 11 seconds 00000100:00100000:1.0:1783966735.572427:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785728 00000100:00100000:1.0:1783966735.572434:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785728 00000100:00100000:1.0:1783966735.572494:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966735.572503:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a004a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785728:12345-0@lo:1000: 00000100:00100000:1.0:1783966735.572601:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a004a6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1870624587785728:12345-0@lo:1000: Request processed in 99us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.572608:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 40000000:02000000:1.0:1783966735.572630:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1783966735.576643:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cf3ea529 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1870624587785728:0@lo:1000: 00000040:00080000:3.0:1783966735.576712:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783966735.576793:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000006dc03f75 with version 1 00000004:00080000:3.0:1783966735.576814:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000282dc5e5 version 1 rpc_version 1 00000020:00100000:3.0:1783966735.576852:0:7462:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783966735.576861:0:7462:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000bb36c677 x1870624587785984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783966735.576889:0:7462:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1870624587785984:0@lo:1000: 00000100:00100000:3.0:1783966735.576998:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966735.577055:0:7462:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a69bc68 going to sleep for 11 seconds 00000040:00080000:3.0:1783966735.579262:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783966735.579382:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1783966735.579632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587785984 00000100:00100000:2.0:1783966735.579645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587785984 00000100:00100000:2.0:1783966735.579720:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783966735.579731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ce17a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1870624587785984:12345-0@lo:1000: 00000001:00080000:0.0:1783966735.581614:0:7447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783966735.581682:0:7447:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb71ec191f988 00100000:10000000:0.0:1783966735.581694:0:7447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1783966735.584692:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e48e3028 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1870624587784832:12345-0@lo:700: Request processed in 45741us (45920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966735.584723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783966735.584836:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000087fd35b8 x1870624587784832/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783966751 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966735.584857:0:7471:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087fd35b8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1870624587784832:0@lo:700: 40000000:02000000:1.0:1783966735.584876:0:7471:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1783966735.587498:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000020:01000004:0.0:1783966735.587596:0:7447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783966735.587647:0:7447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783966735.587682:0:7447:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783966735.587707:0:7447:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:2.0:1783966735.588032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ce17a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1870624587785984:12345-0@lo:1000: Request processed in 8298us (11030us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783966735.588050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1783966735.588149:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1783966735.588155:0:7462:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783966735.588177:0:7462:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1870624587785984:0@lo:1000: 00000020:00000004:0.0:1783966735.589147:0:7447:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783966735.589399:0:7447:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1783966735.625025:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783966735.656473:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783966735.656592:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783966735.656597:0:7471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1783966736.438986:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966737.466170:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966738.487407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966739.512054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783966740.424255:0:7717:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783966740.535714:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966740.855407:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783966740.855432:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4ca6388 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587786112:0@lo:41: 00000100:00100000:1.0:1783966740.855506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966740.855602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786112 00000100:00100000:1.0:1783966740.855609:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786112 00000100:00100000:1.0:1783966740.855659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783966740.855668:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b761c079 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587786112:12345-0@lo:41: 00000004:00000024:1.0:1783966740.855713:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1783966740.855758:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b761c079 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587786112:12345-0@lo:41: Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966740.855765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783966740.855831:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4ca6388 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587786112:0@lo:41: 00000100:00100000:0.0:1783966740.856294:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966740.856303:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587786496:0@lo:400: 00000100:00100000:0.0:1783966740.856339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966740.856379:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786496 00000100:00100000:0.0:1783966740.856383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786496 00000100:00100000:0.0:1783966740.856414:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783966740.856420:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac3aa336 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587786496:12345-0@lo:400: 00000100:00100000:0.0:1783966740.856454:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac3aa336 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587786496:12345-0@lo:400: Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966740.856460:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783966740.856487:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006ef256fb x1870624587786496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966740.856496:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587786496:0@lo:400: 00000100:00100000:2.0:1783966740.856656:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587786368:0@lo:400: 00000100:00100000:2.0:1783966740.856687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966740.856718:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966740.856723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000943d2960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587786240:0@lo:400: 00000100:00100000:2.0:1783966740.856750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966740.856802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786240 00000100:00100000:2.0:1783966740.856806:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786240 00000100:00100000:2.0:1783966740.856835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783966740.856841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016b4aade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+13:3646:x1870624587786240:12345-0@lo:400: 00000100:00100000:2.0:1783966740.856875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016b4aade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+13:3646:x1870624587786240:12345-0@lo:400: Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966740.856893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783966740.856932:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000943d2960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587786240:0@lo:400: 00000100:00100000:0.0:1783966740.857039:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786368 00000100:00100000:0.0:1783966740.857043:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786368 00000100:00100000:0.0:1783966740.857066:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783966740.857071:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f41efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587786368:12345-0@lo:400: 00000100:00100000:0.0:1783966740.857106:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f41efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587786368:12345-0@lo:400: Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966740.857113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1783966740.857136:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fc15cdcb x1870624587786368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966740.857144:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587786368:0@lo:400: 00000020:00000004:0.0:1783966741.528473:0:7769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783966741.528731:0:7769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783966741.564155:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966742.584454:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966743.607054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783966743.926918:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783966743.926925:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05f1a14000 from 4 10000000:01000000:3.0:1783966743.926932:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783966743.926988:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.927003:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.927015:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966743.927054:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786624:0@lo:101: 00000100:00100000:3.0:1783966743.930900:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.930980:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 000000009fd0ea4f going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.931022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786624 00000100:00100000:0.0:1783966743.931043:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786624 00000100:00100000:0.0:1783966743.931158:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783966743.931169:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c989c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+13:6515:x1870624587786624:12345-0@lo:101: 00010000:00010000:0.0:1783966743.931187:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966743.931207:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000134b87a9/0x9269c8b316066acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ac6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.931241:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000134b87a9/0x9269c8b316066acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.931253:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000134b87a9/0x9269c8b316066acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.931265:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000134b87a9, rc 0) 00000100:00100000:0.0:1783966743.931319:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c989c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:6515:x1870624587786624:12345-0@lo:101: Request processed in 152us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.931325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783966743.931558:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb36c677 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786624:0@lo:101: 00010000:00010000:2.0:1783966743.933395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966743.933416:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966743.937019:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3126ba9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786752:0@lo:256: 00000100:00100000:2.0:1783966743.937099:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966743.937139:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 000000009fe7201f going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.937220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786752 00000100:00100000:0.0:1783966743.937229:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786752 00000100:00100000:0.0:1783966743.937282:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783966743.937299:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fcb1c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:6515:x1870624587786752:12345-0@lo:256: 20000000:01000000:0.0:1783966743.937324:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783966743.937347:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783966743.937350:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783966743.937448:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fcb1c6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:6515:x1870624587786752:12345-0@lo:256: Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.937456:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783966743.937675:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3126ba9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786752:0@lo:256: 10000000:01000000:3.0:1783966743.937733:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783966743.937741:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.937751:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000d7e79755/0x9269c8b316066ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966743.937762:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783966743.937765:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ed1cf800 from 21 10000000:01000000:3.0:1783966743.937787:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966743.937816:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.937823:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.937832:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966743.937845:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786880:0@lo:101: 00000100:00100000:3.0:1783966743.937876:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.937894:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018e9f826 going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.939349:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587786880 00000100:00100000:0.0:1783966743.939362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587786880 00000100:00100000:0.0:1783966743.939432:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783966743.939441:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eedf0aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:6515:x1870624587786880:12345-0@lo:101: 00010000:00010000:0.0:1783966743.939458:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966743.939474:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a8c2187/0x9269c8b316066adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ad4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.939578:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a8c2187/0x9269c8b316066adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.939591:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a8c2187/0x9269c8b316066adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.939601:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a8c2187, rc 0) 00000100:00100000:0.0:1783966743.939676:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eedf0aa0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587786880:12345-0@lo:101: Request processed in 236us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.939683:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783966743.941889:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587786880:0@lo:101: 00010000:00010000:3.0:1783966743.941937:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.941949:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966743.942046:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787008:0@lo:501: 00000100:00100000:3.0:1783966743.942348:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.942392:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018e9f826 going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.945916:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787008 00000100:00100000:0.0:1783966743.945930:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787008 00000100:00100000:0.0:1783966743.945985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783966743.945993:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000488d0aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587787008:12345-0@lo:501: 00000100:00100000:0.0:1783966743.946151:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000488d0aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587787008:12345-0@lo:501: Request processed in 159us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.946159:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783966743.946679:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787008:0@lo:501: 00000100:00100000:3.0:1783966743.946725:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787136:0@lo:503: 00000100:00100000:3.0:1783966743.946800:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.946831:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018e9f826 going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.947000:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787136 00000100:00100000:0.0:1783966743.947006:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787136 00000100:00100000:0.0:1783966743.947044:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783966743.947050:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c6b627b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587787136:12345-0@lo:503: 00000100:00100000:0.0:1783966743.947140:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c6b627b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587787136:12345-0@lo:503: Request processed in 91us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.947153:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783966743.948080:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787136:0@lo:503: 00000100:00100000:0.0:1783966743.949268:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7841:1870624587787264:0@lo:502: 00000100:00100000:0.0:1783966743.949343:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.949383:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc8407c3 going to sleep for 11 seconds 00000100:00100000:3.0:1783966743.949486:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787264 00000100:00100000:3.0:1783966743.949510:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787264 00000100:00100000:3.0:1783966743.949554:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783966743.949561:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d332ec96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:7841:x1870624587787264:12345-0@lo:502: 00000100:00100000:3.0:1783966743.949668:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d332ec96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:7841:x1870624587787264:12345-0@lo:502: Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966743.949676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783966743.950015:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7841:1870624587787264:0@lo:502: 00000100:00100000:0.0:1783966743.950061:0:7841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7841:1870624587787392:0@lo:502: 00000100:00100000:0.0:1783966743.950095:0:7841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.950122:0:7841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bc8407c3 going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.950165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787392 00000100:00100000:1.0:1783966743.950169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787392 00000100:00100000:1.0:1783966743.950202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783966743.950209:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac296360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7841:x1870624587787392:12345-0@lo:502: 00000100:00100000:1.0:1783966743.950306:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac296360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:7841:x1870624587787392:12345-0@lo:502: Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.950313:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783966743.950441:0:7841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7841:1870624587787392:0@lo:502: 00000040:00080000:0.0:1783966743.950459:0:7841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783966743.950705:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783966743.950731:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783966743.950742:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.950753:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000008ba4b3bb/0x9269c8b316066ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966743.950763:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783966743.950765:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05ed1cf800 from 4 10000000:01000000:1.0:1783966743.950798:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783966743.950823:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.950838:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.950847:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966743.950860:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4ca6388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787520:0@lo:101: 00000100:00100000:1.0:1783966743.950889:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966743.950910:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b567d70 going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.952611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787520 00000100:00100000:0.0:1783966743.952624:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787520 00000100:00100000:0.0:1783966743.952672:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783966743.952681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041d5839a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587787520:12345-0@lo:101: 00010000:00010000:0.0:1783966743.952696:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966743.952711:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efb9e1e2/0x9269c8b316066ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ae2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.952734:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efb9e1e2/0x9269c8b316066ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.952743:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efb9e1e2/0x9269c8b316066ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.952751:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efb9e1e2, rc 0) 00000100:00100000:0.0:1783966743.952825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041d5839a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587787520:12345-0@lo:101: Request processed in 145us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.952840:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783966743.952895:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4ca6388 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787520:0@lo:101: 00010000:00010000:0.0:1783966743.952912:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.952919:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966743.952980:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787648:0@lo:256: 00000100:00100000:0.0:1783966743.953015:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.953039:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db66784d going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.953052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787648 00000100:00100000:0.0:1783966743.953055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787648 00000100:00100000:0.0:1783966743.953076:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783966743.953082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cb864b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587787648:12345-0@lo:256: 20000000:01000000:0.0:1783966743.953107:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783966743.953122:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783966743.953125:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783966743.953197:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cb864b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587787648:12345-0@lo:256: Request processed in 115us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.953204:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783966743.953231:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787648:0@lo:256: 10000000:01000000:0.0:1783966743.953268:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783966743.953275:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953281:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 0000000018789e97/0x9269c8b316066ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966743.953294:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783966743.953296:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783966743.953299:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783966743.953315:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953321:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953328:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966743.953339:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787776:0@lo:101: 00000100:00100000:0.0:1783966743.953363:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.953374:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db66784d going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.953384:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787776 00000100:00100000:0.0:1783966743.953386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787776 00000100:00100000:0.0:1783966743.953404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966743.953409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0073410 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587787776:12345-0@lo:101: 00010000:00010000:0.0:1783966743.953416:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966743.953422:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb4ff90a/0x9269c8b316066af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066af0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb4ff90a/0x9269c8b316066af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066af0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953442:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb4ff90a/0x9269c8b316066af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066af0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.953458:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb4ff90a, rc 0) 00000100:00100000:0.0:1783966743.953483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0073410 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587787776:12345-0@lo:101: Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.954716:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966743.954880:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787776:0@lo:101: 00010000:00010000:0.0:1783966743.954898:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966743.954908:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966743.954977:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787904:0@lo:501: 00000100:00100000:0.0:1783966743.955016:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.955039:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000db66784d going to sleep for 11 seconds 00000100:00100000:3.0:1783966743.955316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587787904 00000100:00100000:3.0:1783966743.955322:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587787904 00000100:00100000:3.0:1783966743.955360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783966743.955367:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000844307e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587787904:12345-0@lo:501: 00000100:00100000:3.0:1783966743.955663:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000844307e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587787904:12345-0@lo:501: Request processed in 296us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966743.955683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783966743.955717:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc15cdcb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587787904:0@lo:501: 00000100:00100000:3.0:1783966743.955746:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587788032:0@lo:503: 00000100:00100000:3.0:1783966743.955850:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.955872:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e4c12db2 going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.955938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788032 00000100:00100000:1.0:1783966743.955943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788032 00000100:00100000:1.0:1783966743.955966:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783966743.955971:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e51f2965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587788032:12345-0@lo:503: 00000100:00100000:1.0:1783966743.956059:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e51f2965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587788032:12345-0@lo:503: Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.956066:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783966743.956169:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587788032:0@lo:503: 00000100:00100000:3.0:1783966743.956560:0:7843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7843:1870624587788160:0@lo:502: 00000100:00100000:3.0:1783966743.956656:0:7843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.956687:0:7843:0:(client.c:2702:ptlrpc_set_wait()) set 000000009fd0ea4f going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.956726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788160 00000100:00100000:1.0:1783966743.956730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788160 00000100:00100000:1.0:1783966743.956760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783966743.956766:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4dc97ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:7843:x1870624587788160:12345-0@lo:502: 00000100:00100000:1.0:1783966743.957090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4dc97ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:7843:x1870624587788160:12345-0@lo:502: Request processed in 324us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.957098:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783966743.957162:0:7843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7843:1870624587788160:0@lo:502: 00000020:01000000:3.0:1783966743.957187:0:7843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966743.957198:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966743.957201:0:7843:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783966743.957206:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783966743.957209:0:7843:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:3.0:1783966743.957235:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783966743.957250:0:7843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001fefc233) 00000020:00000080:3.0:1783966743.957270:0:7843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1783966743.957276:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783966743.957436:0:7843:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783966743.957443:0:7843:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783966743.957451:0:7843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066b05 00010000:00080000:3.0:1783966743.957480:0:7843:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bb75cd49@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783966743.963141:0:7843:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1783966743.966360:0:7843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783966743.966376:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1783966743.966415:0:7843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783966743.966438:0:7843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066b0c 00000100:00080000:2.0:1783966743.966449:0:7843:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783966743.966455:0:7843:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000bb75cd49 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966743.966507:0:7843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000661a60d7 x1870624587788288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783966743.966534:0:7843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1783966743.966580:0:7843:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1783966743.966898:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966743.966913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587788416:0@lo:400: 00000100:00100000:0.0:1783966743.966976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.967013:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c6430e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587788544:0@lo:400: 00000100:00100000:0.0:1783966743.967039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.967058:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966743.967062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c72cae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587788672:0@lo:400: 00000100:00100000:0.0:1783966743.967082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.967126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788416 00000100:00100000:0.0:1783966743.967133:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788416 00000100:00100000:0.0:1783966743.967176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788672 00000100:00100000:0.0:1783966743.967179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788672 00000100:00100000:3.0:1783966743.967192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966743.967204:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057f859ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587788416:12345-0@lo:400: 00000100:00100000:0.0:1783966743.967210:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783966743.967219:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783966743.967236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788544 00000100:00100000:0.0:1783966743.967239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788544 00000100:00100000:0.0:1783966743.967264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783966743.967270:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002653a14c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587788544:12345-0@lo:400: 00000100:00100000:0.0:1783966743.967323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002653a14c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587788544:12345-0@lo:400: Request processed in 53us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.967330:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783966743.967349:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783966743.967356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783966743.967362:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1504a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587788672:12345-0@lo:400: 00000100:00100000:3.0:1783966743.967393:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057f859ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587788416:12345-0@lo:400: Request processed in 191us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.967401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1504a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587788672:12345-0@lo:400: Request processed in 38us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966743.967402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783966743.967412:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783966743.967450:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c72cae51 x1870624587788672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966743.967463:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c72cae51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587788672:0@lo:400: 00000100:00100000:0.0:1783966743.967473:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c6430e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587788544:0@lo:400: 00010000:00080000:0.0:1783966743.967507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006ef256fb x1870624587788416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966743.967515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587788416:0@lo:400: 00000100:00100000:1.0:1783966743.968097:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587788288:0@lo:38: 00000100:00100000:1.0:1783966743.968140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.968216:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788288 00000100:00100000:3.0:1783966743.968221:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788288 00000100:00100000:3.0:1783966743.968257:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783966743.968261:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ca6388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587788288:12345-0@lo:38: 00010000:00080000:3.0:1783966743.968295:0:6523:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1783966743.968328:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066b13 00000004:00100000:3.0:1783966743.968343:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783966743.968349:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783966743.968996:0:7846:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000026efbf08 x1870624587788800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966743.969006:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afb1ac38 going to sleep for 0 seconds 00000020:01000000:0.0:1783966743.969093:0:7843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966743.969099:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966743.969101:0:7843:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783966743.969104:0:7843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966743.969108:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966743.969114:0:7843:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783966743.969118:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783966743.969119:0:7843:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783966743.969140:0:7843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7843:1870624587788928:0@lo:502: 00000100:00100000:0.0:1783966743.969193:0:7843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.969283:0:7843:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f037354 going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.970251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788928 00000100:00100000:1.0:1783966743.970269:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788928 00000100:00100000:1.0:1783966743.970318:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783966743.970324:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085cc6749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:7843:x1870624587788928:12345-0@lo:502: 00000100:00100000:1.0:1783966743.970543:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085cc6749 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:7843:x1870624587788928:12345-0@lo:502: Request processed in 219us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.970551:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783966743.970595:0:7843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:7843:1870624587788928:0@lo:502: 00000020:01000000:0.0:1783966743.970632:0:7843:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966743.970638:0:7843:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966743.970640:0:7843:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783966743.970644:0:7843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1783966743.970738:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783966743.970766:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783966743.971130:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.971140:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 00000000df5bbac8/0x9269c8b316066af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966743.971152:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783966743.971154:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:1.0:1783966743.971157:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783966743.971187:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.971194:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966743.971202:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966743.971219:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587789056:0@lo:101: 00000100:00100000:1.0:1783966743.971263:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966743.971288:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057b06d2b going to sleep for 11 seconds 00000100:00100000:2.0:1783966743.971409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789056 00000100:00100000:2.0:1783966743.971415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789056 00000100:00100000:2.0:1783966743.971482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783966743.971510:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a9752d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587789056:12345-0@lo:101: 00010000:00010000:2.0:1783966743.971521:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966743.971532:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9b5239e/0x9269c8b316066b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966743.971553:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9b5239e/0x9269c8b316066b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966743.971563:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9b5239e/0x9269c8b316066b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966743.971570:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9b5239e, rc 0) 00000100:00100000:2.0:1783966743.971608:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a9752d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587789056:12345-0@lo:101: Request processed in 111us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966743.971615:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966743.973032:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000252b0995 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587789056:0@lo:101: 00010000:00010000:3.0:1783966743.973057:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.973068:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966743.973285:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084631f59 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587789184:0@lo:501: 00000100:00100000:3.0:1783966743.973404:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.974831:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f545a7ea going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.976828:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789184 00000100:00100000:1.0:1783966743.976859:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789184 00000100:00100000:1.0:1783966743.976922:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783966743.976933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad15918a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587789184:12345-0@lo:501: 00000100:00100000:0.0:1783966743.978082:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad15918a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587789184:12345-0@lo:501: Request processed in 1148us (4674us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783966743.978106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783966743.978237:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084631f59 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587789184:0@lo:501: 10000000:01000000:3.0:1783966743.978359:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783966743.978374:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966743.978384:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: 000000003ee01192/0x9269c8b316066b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783966743.982037:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000157e0a80 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966743.982143:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ca6388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587788288:12345-0@lo:38: Request processed in 13879us (14002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966743.982155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783966743.983580:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966743.983595:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783966743.983605:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783966743.983610:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783966743.983613:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000bb75cd49 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783966743.983641:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000afb1ac38): req@0000000026efbf08 x1870624587788800/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966743.983660:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587788288:0@lo:38: 00000100:00100000:1.0:1783966743.983743:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587789312:0@lo:41: 00000100:00100000:1.0:1783966743.983816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966743.984196:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789312 00000100:00100000:0.0:1783966743.984204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789312 00000100:00100000:0.0:1783966743.984259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783966743.984268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5cb1ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587789312:12345-0@lo:41: 00000004:00000024:0.0:1783966743.984304:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783966743.984350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5cb1ed0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587789312:12345-0@lo:41: Request processed in 84us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.984357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783966743.984752:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ef256fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587789312:0@lo:41: 00000100:00100000:3.0:1783966743.984759:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966743.986858:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afb1ac38 going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.992052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587788800 00000100:00100000:0.0:1783966743.992139:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587788800 00000100:00100000:0.0:1783966743.992334:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783966743.992345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084631f59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587788800:12345-0@lo:1000: 00000100:00100000:0.0:1783966743.992485:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084631f59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587788800:12345-0@lo:1000: Request processed in 141us (7728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966743.992492:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783966743.992631:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026efbf08 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587788800:0@lo:1000: 00000040:01000000:2.0:1783966743.992671:0:7846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783966743.992711:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789440:0@lo:1000: 00000100:00100000:2.0:1783966743.992760:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966743.992949:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 000000009fe7201f going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.993037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789440 00000100:00100000:1.0:1783966743.993043:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789440 00000100:00100000:1.0:1783966743.993075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783966743.993081:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3126ba9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789440:12345-0@lo:1000: 00000100:00100000:1.0:1783966743.993212:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3126ba9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789440:12345-0@lo:1000: Request processed in 131us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.993220:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966743.993483:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789440:0@lo:1000: 00000100:00100000:2.0:1783966743.993540:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789568:0@lo:700: 00000100:00100000:2.0:1783966743.993693:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966743.993721:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 000000000ebecb73 going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.993809:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789568 00000100:00100000:1.0:1783966743.993814:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789568 00000100:00100000:1.0:1783966743.993848:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966743.993855:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3ea529 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789568:12345-0@lo:700: 00000100:00100000:1.0:1783966743.993912:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3ea529 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789568:12345-0@lo:700: Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.993926:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966743.994295:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789568:0@lo:700: 00000100:00100000:2.0:1783966743.994424:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789696:0@lo:1000: 00000100:00100000:2.0:1783966743.994464:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966743.994487:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d2e255c going to sleep for 11 seconds 00000100:00100000:1.0:1783966743.994738:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789696 00000100:00100000:1.0:1783966743.994743:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789696 00000100:00100000:1.0:1783966743.994789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783966743.994797:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b50af6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789696:12345-0@lo:1000: 00000100:00100000:1.0:1783966743.994867:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b50af6e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789696:12345-0@lo:1000: Request processed in 71us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966743.994875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783966743.994957:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789696:0@lo:1000: 00000004:00080000:2.0:1783966743.995005:0:7846:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000ebecb73 with version 0 00000020:00100000:2.0:1783966743.995022:0:7846:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1783966743.995028:0:7846:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000661a60d7 x1870624587789952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783966743.995041:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789952:0@lo:1000: 00000100:00100000:2.0:1783966743.995064:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966743.995076:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d2e255c going to sleep for 11 seconds 00000100:00100000:0.0:1783966743.995127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587789952 00000100:00100000:0.0:1783966743.995133:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587789952 00000100:00100000:0.0:1783966743.995155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783966743.995231:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f27256b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1870624587789952:12345-0@lo:1000: 00000001:00080000:1.0:1783966744.000043:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1783966744.000058:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783966744.000664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f27256b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7846:x1870624587789952:12345-0@lo:1000: Request processed in 5498us (5593us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783966744.000679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1783966744.000900:0:7846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1783966744.000906:0:7846:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783966744.000921:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000661a60d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587789952:0@lo:1000: 00000100:00100000:0.0:1783966744.001019:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008c6430e8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587790080:0@lo:1000: 00000100:00100000:0.0:1783966744.001122:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966744.001266:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050d0b377 going to sleep for 11 seconds 00000100:00100000:1.0:1783966744.001301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790080 00000100:00100000:1.0:1783966744.001509:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790080 00000100:00100000:1.0:1783966744.001591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783966744.001600:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c72cae51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7846:x1870624587790080:12345-0@lo:1000: 00000100:00100000:1.0:1783966744.001681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c72cae51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7846:x1870624587790080:12345-0@lo:1000: Request processed in 83us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966744.001690:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783966744.001749:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008c6430e8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7846:1870624587790080:0@lo:1000: 00000040:00080000:0.0:1783966744.001802:0:7846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1783966744.001838:0:7846:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000050d0b377 with version 1 00000004:00080000:3.0:1783966744.001866:0:7844:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000c722adce version 1 rpc_version 1 00000020:00100000:3.0:1783966744.001888:0:7844:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783966744.001896:0:7844:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003911e038 x1870624587790336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783966744.002757:0:7844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003911e038 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7844:1870624587790336:0@lo:1000: 00000100:00100000:3.0:1783966744.002840:0:7844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783966744.003980:0:7846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783966744.004063:0:7846:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1783966744.004068:0:7846:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1783966744.004621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790336 00000100:00100000:2.0:1783966744.004632:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790336 00000100:00100000:3.0:1783966744.004659:0:7844:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c85350e4 going to sleep for 11 seconds 00000100:00100000:2.0:1783966744.004682:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783966744.004692:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf3e36c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7844:x1870624587790336:12345-0@lo:1000: 00000001:00080000:2.0:1783966744.006524:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1783966744.006950:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf3e36c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7844:x1870624587790336:12345-0@lo:1000: Request processed in 2257us (4106us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783966744.006963:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1783966744.007030:0:7844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1783966744.007036:0:7844:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783966744.007057:0:7844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003911e038 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7844:1870624587790336:0@lo:1000: 00000020:00000004:0.0:1783966744.432381:0:7877:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783966744.432606:0:7877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783966744.637157:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783966745.414874:0:7925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc12e07640 20000000:00000080:3.0:1783966745.414889:0:7925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05f5742c00 uarg=0000000000000000 20000000:01000000:3.0:1783966745.414925:0:7925:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783966745.414932:0:7925:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783966745.414936:0:7925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783966745.415013:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1783966745.415023:0:7925:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1783966745.419243:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966745.419743:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783966745.420196:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1783966745.420225:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1783966745.420247:0:7925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783966745.424181:0:7925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.424217:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.424225:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.424232:0:7925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.424298:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.424318:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966745.424830:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003911e038 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1870624587790464:0@lo:104: 00000100:00100000:2.0:1783966745.425236:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783966745.425390:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.425414:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 17 pid: 6512 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966745.425444:0:7925:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d42c9a09 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1870624587790592:0@lo:104: 00000100:00100000:2.0:1783966745.425467:0:7925:0:(client.c:2702:ptlrpc_set_wait()) set 0000000092db5b2b going to sleep for 11 seconds 00000100:00100000:0.0:1783966745.428292:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783966745.428534:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966745.428628:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790464 00000100:00100000:0.0:1783966745.428639:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790464 00000100:00100000:3.0:1783966745.428701:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790592 00000100:00100000:3.0:1783966745.428704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790592 00000100:00100000:3.0:1783966745.428729:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966745.428737:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de905d33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:7925:x1870624587790464:12345-0@lo:104: 00010000:00010000:3.0:1783966745.428759:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.428939:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966745.428945:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de905d33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:7925:x1870624587790464:12345-0@lo:104: Request processed in 209us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966745.428982:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966745.429042:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966745.429048:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c6430e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:7925:x1870624587790592:12345-0@lo:104: 00010000:00010000:3.0:1783966745.429055:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429091:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783966745.429096:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c6430e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:7925:x1870624587790592:12345-0@lo:104: Request processed in 49us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966745.429102:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1783966745.429121:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783966745.429127:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429135:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066c4ca69 already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966745.429139:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429147:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966745.429155:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966745.429161:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966745.429209:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429217:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966745.429250:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429258:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 0000000066c4ca69/0x9269c8b316066a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a95 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429274:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966745.429277:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429282:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000054c1122 already unused, calling callback (000000007702abdd) 10000000:00010000:3.0:1783966745.429284:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429289:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966745.429295:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966745.429300:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966745.429313:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429319:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966745.429344:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429350:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b3160669a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160669a7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.429365:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966745.429371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966745.429373:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966745.429378:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966745.429948:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a58941cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587790720:0@lo:103: 00000100:00100000:3.0:1783966745.430008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966745.430305:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003911e038 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1870624587790464:0@lo:104: 00000100:00100000:2.0:1783966745.430318:0:7925:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d42c9a09 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1870624587790592:0@lo:104: 00010000:00010000:2.0:1783966745.430584:0:7925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966745.430693:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041add946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587790848:0@lo:103: 00000100:00100000:3.0:1783966745.430726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966745.431087:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790720 00000100:00100000:1.0:1783966745.431096:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790720 00000100:00100000:2.0:1783966745.431118:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790848 00000100:00100000:2.0:1783966745.431122:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790848 00010000:00010000:2.0:1783966745.431137:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 19 pid: 6512 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966745.431215:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 19 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966745.431225:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783966745.431233:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb36c677 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+19:3645:x1870624587790848:12345-0@lo:103: 00010000:00010000:2.0:1783966745.431253:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966745.431258:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 19 pid: 6512 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431269:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 19 pid: 6512 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431287:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054f98fea/0x9269c8b3160669a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160669a0 expref: 19 pid: 6512 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431308:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966745.431358:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb36c677 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3645:x1870624587790848:12345-0@lo:103: Request processed in 127us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966745.431364:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783966745.431398:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783966745.431403:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026efbf08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+17:3648:x1870624587790720:12345-0@lo:103: 00010000:00010000:2.0:1783966745.431409:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966745.431412:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431420:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431429:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a679dffe/0x9269c8b316066a95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066a8e expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431442:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431450:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431466:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431483:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431490:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431496:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431502:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046376924 already unused, calling callback (000000005001ecdc) 00010000:00010000:2.0:1783966745.431505:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431520:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431535:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966745.431546:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966745.431569:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026efbf08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+16:3648:x1870624587790720:12345-0@lo:103: Request processed in 167us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966745.431575:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966745.431635:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041add946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587790848:0@lo:103: 00000100:00100000:3.0:1783966745.431658:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a58941cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587790720:0@lo:103: 00010000:00010000:3.0:1783966745.431821:0:7925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.431829:0:7925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.431835:0:7925:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046376924/0x9269c8b316066b28 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966745.655813:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966745.984049:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966745.984076:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a58941cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587790976:0@lo:41: 00000100:00100000:1.0:1783966745.984164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966745.984420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587790976 00000100:00100000:3.0:1783966745.984429:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587790976 00000100:00100000:3.0:1783966745.984497:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783966745.984506:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000be084f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587790976:12345-0@lo:41: 00000004:00000024:3.0:1783966745.984544:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1783966745.984603:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000be084f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587790976:12345-0@lo:41: Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966745.984610:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783966745.986867:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a58941cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587790976:0@lo:41: 00010000:00010000:3.0:1783966746.681901:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966747.702997:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966748.728005:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966749.048708:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f884b42d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587791232:0@lo:400: 00000100:00100000:3.0:1783966749.048854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966749.048919:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783966749.048925:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041add946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587791104:0@lo:400: 00000100:00100000:3.0:1783966749.048957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966749.048978:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587791616:0@lo:400: 00000100:00100000:3.0:1783966749.049026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966749.049058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791232 00000100:00100000:3.0:1783966749.049066:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791232 00000100:00100000:3.0:1783966749.049111:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966749.049119:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d646b9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587791232:12345-0@lo:400: 00000100:00100000:3.0:1783966749.049172:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d646b9a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587791232:12345-0@lo:400: Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966749.049180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783966749.049203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791104 00000100:00100000:3.0:1783966749.049206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791104 00000100:00100000:3.0:1783966749.049229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783966749.049235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000367b1ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:3648:x1870624587791104:12345-0@lo:400: 00000100:00100000:3.0:1783966749.049263:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000367b1ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:3648:x1870624587791104:12345-0@lo:400: Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966749.049269:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783966749.049293:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791616 00000100:00100000:3.0:1783966749.049297:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791616 00000100:00100000:3.0:1783966749.049321:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783966749.049326:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e914a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587791616:12345-0@lo:400: 00000100:00100000:3.0:1783966749.049359:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e914a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587791616:12345-0@lo:400: Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966749.049376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783966749.049445:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041add946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587791104:0@lo:400: 00000100:00100000:3.0:1783966749.049457:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587791616:0@lo:400: 00010000:00080000:3.0:1783966749.049467:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f884b42d x1870624587791232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966749.049477:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f884b42d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587791232:0@lo:400: 00000100:00100000:0.0:1783966749.049730:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009cceb0cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587791488:0@lo:400: 00000100:00100000:3.0:1783966749.051351:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5e3ccfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587791360:0@lo:400: 00000100:00100000:0.0:1783966749.054911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966749.054981:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791488 00000100:00100000:0.0:1783966749.054990:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791488 00000100:00100000:0.0:1783966749.055100:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783966749.055121:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d1770bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587791488:12345-0@lo:400: 00000100:00100000:0.0:1783966749.055178:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d1770bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587791488:12345-0@lo:400: Request processed in 59us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966749.055185:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783966749.055205:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966749.055216:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ff25aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587791744:0@lo:41: 00000100:00100000:0.0:1783966749.055251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966749.055280:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791744 00000100:00100000:0.0:1783966749.055284:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791744 00000100:00100000:0.0:1783966749.055307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783966749.055312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ef256fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587791744:12345-0@lo:41: 00000004:00000024:0.0:1783966749.055338:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783966749.055371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ef256fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587791744:12345-0@lo:41: Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966749.055377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783966749.055424:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ff25aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587791744:0@lo:41: 00010000:00080000:0.0:1783966749.055458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009cceb0cd x1870624587791488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966749.055469:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009cceb0cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587791488:0@lo:400: 00000100:00100000:3.0:1783966749.057923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966749.058119:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791360 00000100:00100000:0.0:1783966749.058129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791360 00000100:00100000:0.0:1783966749.058177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783966749.058186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f884b42d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587791360:12345-0@lo:400: 00000100:00100000:0.0:1783966749.058257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f884b42d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587791360:12345-0@lo:400: Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966749.058265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783966749.059147:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5e3ccfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587791360:0@lo:400: 00010000:00010000:2.0:1783966749.750924:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966750.774925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966751.097454:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587791872:0@lo:41: 00000100:00100000:3.0:1783966751.097523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966751.097727:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587791872 00000100:00100000:0.0:1783966751.097733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587791872 00000100:00100000:3.0:1783966751.097910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783966751.097920:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041add946 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587791872:12345-0@lo:41: 00000004:00000024:3.0:1783966751.097957:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1783966751.098007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041add946 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587791872:12345-0@lo:41: Request processed in 90us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966751.098014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783966751.098055:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587791872:0@lo:41: 00010000:00010000:0.0:1783966751.799628:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783966752.630860:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783966752.630868:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f1a14000 from 1 10000000:01000000:3.0:1783966752.630871:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783966752.631041:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b316066b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631053:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b316066b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631077:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b316066b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966752.631102:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792000:0@lo:101: 00000100:00100000:3.0:1783966752.631171:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.631223:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075105219 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.631247:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792000 00000100:00100000:3.0:1783966752.631254:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792000 00000100:00100000:3.0:1783966752.631302:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783966752.631310:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c23599a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587792000:12345-0@lo:101: 00010000:00010000:3.0:1783966752.631322:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966752.631354:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046376924/0x9269c8b316066b36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b2f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631376:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046376924/0x9269c8b316066b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b2f expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631386:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046376924/0x9269c8b316066b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b2f expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631395:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046376924, rc 0) 00000100:00100000:3.0:1783966752.631445:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c23599a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792000:12345-0@lo:101: Request processed in 135us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.631458:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783966752.631515:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792000:0@lo:101: 00010000:00010000:3.0:1783966752.631531:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b316066b2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.631556:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: 00000000054c1122/0x9269c8b316066b2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966752.631625:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792128:0@lo:501: 00000100:00100000:3.0:1783966752.631661:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.631674:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075105219 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.631693:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792128 00000100:00100000:3.0:1783966752.631697:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792128 00000100:00100000:3.0:1783966752.631716:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783966752.631721:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025e0d254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792128:12345-0@lo:501: 00000100:00100000:3.0:1783966752.632743:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025e0d254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792128:12345-0@lo:501: Request processed in 1018us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.632753:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783966752.632913:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792128:0@lo:501: 00000100:00100000:3.0:1783966752.633025:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792256:0@lo:503: 00000100:00100000:3.0:1783966752.633072:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.633097:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075105219 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.633113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792256 00000100:00100000:3.0:1783966752.633117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792256 00000100:00100000:3.0:1783966752.633152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783966752.633159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022d2c127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792256:12345-0@lo:503: 00000100:00100000:3.0:1783966752.633738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022d2c127 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792256:12345-0@lo:503: Request processed in 579us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.633748:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783966752.634689:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792256:0@lo:503: 00000100:00100000:3.0:1783966752.635019:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8279:1870624587792384:0@lo:502: 00000100:00100000:3.0:1783966752.635074:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.635104:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792384 00000100:00100000:3.0:1783966752.635109:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792384 00000100:00100000:3.0:1783966752.635141:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783966752.635148:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005098350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8279:x1870624587792384:12345-0@lo:502: 00000100:00100000:3.0:1783966752.635246:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005098350 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8279:x1870624587792384:12345-0@lo:502: Request processed in 99us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.635254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783966752.635293:0:8279:0:(client.c:2702:ptlrpc_set_wait()) set 00000000700dcc31 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.635307:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000da62d565 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8279:1870624587792384:0@lo:502: 00000020:01000000:3.0:1783966752.635327:0:8279:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966752.635351:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966752.635354:0:8279:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783966752.635360:0:8279:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f1a14000 00000020:00000080:3.0:1783966752.635362:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783966752.635400:0:8279:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8279:1870624587792512:0@lo:502: 00000100:00100000:3.0:1783966752.635443:0:8279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.635468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792512 00000100:00100000:3.0:1783966752.635472:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792512 00000100:00100000:3.0:1783966752.635498:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783966752.635504:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:8279:x1870624587792512:12345-0@lo:502: 00000100:00100000:3.0:1783966752.635569:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:8279:x1870624587792512:12345-0@lo:502: Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.635576:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783966752.635611:0:8279:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.635630:0:8279:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8279:1870624587792512:0@lo:502: 00000020:01000000:3.0:1783966752.635654:0:8279:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966752.635657:0:8279:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966752.635659:0:8279:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783966752.635663:0:8279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783966752.635716:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783966752.635737:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966752.635747:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.635757:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966752.635786:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783966752.635788:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ed1cf800 from 1 10000000:01000000:3.0:1783966752.635791:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783966752.635814:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.635822:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.635832:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966752.635843:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792640:0@lo:101: 00000100:00100000:3.0:1783966752.635866:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.635885:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.635897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792640 00000100:00100000:3.0:1783966752.635900:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792640 00000100:00100000:3.0:1783966752.636800:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783966752.636813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587792640:12345-0@lo:101: 00010000:00010000:3.0:1783966752.636845:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966752.636861:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b3d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.636884:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b3d expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.636895:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b3d expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.636905:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179800, rc 0) 00000100:00100000:3.0:1783966752.637172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587792640:12345-0@lo:101: Request processed in 361us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.637180:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783966752.637243:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792640:0@lo:101: 00010000:00010000:3.0:1783966752.637261:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.637271:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966752.637329:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792768:0@lo:501: 00000100:00100000:3.0:1783966752.637375:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.637398:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.637411:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792768 00000100:00100000:3.0:1783966752.637414:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792768 00000100:00100000:3.0:1783966752.637452:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783966752.637459:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587792768:12345-0@lo:501: 00000100:00100000:3.0:1783966752.637559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587792768:12345-0@lo:501: Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.637566:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783966752.637593:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792768:0@lo:501: 00000100:00100000:3.0:1783966752.637619:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792896:0@lo:503: 00000100:00100000:3.0:1783966752.637653:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.637665:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966752.637676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587792896 00000100:00100000:3.0:1783966752.637679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587792896 00000100:00100000:3.0:1783966752.637702:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783966752.637708:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587792896:12345-0@lo:503: 00000100:00100000:3.0:1783966752.637796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587792896:12345-0@lo:503: Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966752.637802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783966752.638008:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587792896:0@lo:503: 00000100:00100000:3.0:1783966752.640760:0:8280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8280:1870624587793024:0@lo:502: 00000100:00100000:3.0:1783966752.640894:0:8280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.640940:0:8280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966752.641122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793024 00000100:00100000:0.0:1783966752.641130:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793024 00000100:00100000:0.0:1783966752.641305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783966752.641317:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8280:x1870624587793024:12345-0@lo:502: 00000100:00100000:0.0:1783966752.641469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8280:x1870624587793024:12345-0@lo:502: Request processed in 154us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966752.641478:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783966752.641626:0:8280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8280:1870624587793024:0@lo:502: 00000020:01000000:3.0:1783966752.641657:0:8280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966752.641666:0:8280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966752.641669:0:8280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783966752.641676:0:8280:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05ed1cf800 00000020:00000080:3.0:1783966752.641679:0:8280:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783966752.641703:0:8280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8280:1870624587793152:0@lo:502: 00000100:00100000:3.0:1783966752.641743:0:8280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966752.641785:0:8280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966752.641853:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793152 00000100:00100000:1.0:1783966752.641858:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793152 00000100:00100000:1.0:1783966752.641892:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783966752.641899:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:8280:x1870624587793152:12345-0@lo:502: 00000100:00100000:1.0:1783966752.642100:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:8280:x1870624587793152:12345-0@lo:502: Request processed in 201us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966752.642106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783966752.642161:0:8280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8280:1870624587793152:0@lo:502: 00000020:01000000:0.0:1783966752.642187:0:8280:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966752.642193:0:8280:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966752.642195:0:8280:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783966752.642199:0:8280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783966752.642301:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783966752.642326:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966752.642346:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966752.642357:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966752.824684:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966753.850610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966754.167640:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587793280:0@lo:41: 00000100:00100000:3.0:1783966754.167717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966754.167804:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793280 00000100:00100000:3.0:1783966754.167813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793280 00000100:00100000:3.0:1783966754.167860:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783966754.167869:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587793280:12345-0@lo:41: 00000004:00000024:3.0:1783966754.167916:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783966754.168021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587793280:0@lo:41: 00000100:00100000:3.0:1783966754.168087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587793280:12345-0@lo:41: Request processed in 217us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966754.168095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966754.168542:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587793664:0@lo:400: 00000100:00100000:1.0:1783966754.168576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966754.168602:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966754.168608:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587793792:0@lo:400: 00000100:00100000:1.0:1783966754.168633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966754.168668:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793792 00000100:00100000:1.0:1783966754.168672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793792 00000100:00100000:1.0:1783966754.168706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783966754.168713:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587793792:12345-0@lo:400: 00000100:00100000:1.0:1783966754.168752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587793792:12345-0@lo:400: Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966754.168759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783966754.168817:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f4cac700 x1870624587793792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966754.168828:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587793792:0@lo:400: 00000100:00100000:2.0:1783966754.168919:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587793408:0@lo:400: 00000100:00100000:2.0:1783966754.168953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966754.168992:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966754.168998:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587793536:0@lo:400: 00000100:00100000:2.0:1783966754.169019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966754.169044:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793536 00000100:00100000:2.0:1783966754.169047:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793536 00000100:00100000:2.0:1783966754.169072:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783966754.169078:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587793536:12345-0@lo:400: 00000100:00100000:2.0:1783966754.169110:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587793536:12345-0@lo:400: Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966754.169117:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783966754.169152:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793664 00000100:00100000:2.0:1783966754.169155:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793664 00000100:00100000:2.0:1783966754.169179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783966754.169185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587793664:12345-0@lo:400: 00000100:00100000:2.0:1783966754.169247:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587793664:12345-0@lo:400: Request processed in 62us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966754.169253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783966754.169278:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f4cadf80 x1870624587793536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966754.169288:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587793536:0@lo:400: 00000100:00100000:2.0:1783966754.169333:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587793664:0@lo:400: 00000100:00100000:1.0:1783966754.169708:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793408 00000100:00100000:1.0:1783966754.169713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793408 00000100:00100000:1.0:1783966754.169755:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783966754.169763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:3647:x1870624587793408:12345-0@lo:400: 00000100:00100000:1.0:1783966754.169832:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:3647:x1870624587793408:12345-0@lo:400: Request processed in 70us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966754.169838:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783966754.171517:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587793408:0@lo:400: 00010000:00010000:0.0:1783966754.878192:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783966755.388431:0:8425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783966755.388435:0:8425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783966755.388437:0:8425:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783966755.388574:0:8425:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05fcff3800 00000020:01000004:2.0:1783966755.388590:0:8425:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783966755.388603:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783966755.388624:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a05f55f0000) 00000020:00000080:2.0:1783966755.388641:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783966755.449700:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783966755.449797:0:8425:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1783966755.488444:0:8425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783966755.488713:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783966755.488727:0:8425:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783966755.488740:0:8425:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b316066b52 00000020:01000004:1.0:1783966755.488747:0:8425:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783966755.488803:0:8425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783966755.488808:0:8425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783966755.488814:0:8425:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783966755.488819:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783966755.488830:0:8425:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a05ee17cd40) 00000020:00000080:1.0:1783966755.488966:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1783966755.491392:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783966755.491588:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783966755.491594:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783966755.499257:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783966755.499270:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783966755.500629:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783966755.500640:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783966755.504258:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783966755.504432:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783966755.504438:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783966755.511077:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783966755.511097:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783966755.561318:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783966755.561539:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783966755.561557:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783966755.565222:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783966755.565237:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783966755.568093:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783966755.568107:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783966755.572965:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783966755.573139:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783966755.573146:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783966755.579382:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783966755.579397:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783966755.626490:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783966755.626749:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783966755.626761:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783966755.628643:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783966755.628656:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783966755.629268:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783966755.629306:0:8425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1783966755.629312:0:8425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783966755.651732:0:8425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783966755.651851:0:8425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783966755.651859:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783966755.651861:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783966755.651862:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966755.651863:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966755.651864:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966755.651865:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966755.651866:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966755.651867:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966755.651869:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966755.651870:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966755.651871:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783966755.651875:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783966755.651877:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783966755.651878:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783966755.651879:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966755.651879:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966755.651880:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966755.651881:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966755.651882:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966755.651883:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966755.651884:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966755.651884:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966755.651885:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783966755.651910:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783966755.651929:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587793920:0@lo:253: 00000100:00100000:3.0:1783966755.652010:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.652126:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.652229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587793920 00000100:00100000:0.0:1783966755.652236:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587793920 00000100:00100000:0.0:1783966755.652328:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783966755.652337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:8425:x1870624587793920:12345-0@lo:253: 20000000:01000000:0.0:1783966755.652368:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783966755.652372:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1783966755.652377:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1783966755.652380:0:6511:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1783966755.652741:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783966755.653346:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1783966755.653362:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1783966755.653387:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1783966755.653393:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1783966755.653405:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1783966755.653419:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1783966755.653594:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1783966755.653611:0:6511:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:0.0:1783966755.653613:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966755.653631:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1783966755.653637:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783966755.653650:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1783966755.653655:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966755.653667:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1783966755.653673:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783966755.653685:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1783966755.653701:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1783966755.653866:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1783966755.653879:0:6511:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:0.0:1783966755.653881:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966755.653897:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1783966755.653903:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783966755.653918:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1783966755.653923:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966755.653936:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1783966755.653942:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783966755.653953:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1783966755.653970:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1783966755.654524:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1783966755.654538:0:6511:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:0.0:1783966755.654540:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:0.0:1783966755.654554:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1783966755.654559:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783966755.654587:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1783966755.654593:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:0.0:1783966755.654607:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1783966755.654613:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783966755.654625:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1783966755.654640:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1783966755.654653:0:6511:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783966755.654656:0:6511:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783966755.654660:0:6511:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783966755.654704:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783966755.654707:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966755.655231:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966755.655257:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966755.655274:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1783966755.655474:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1783966755.655493:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1783966755.655506:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1783966755.655514:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1783966755.655516:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783966755.655877:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1783966755.656026:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1783966755.656049:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1783966755.656067:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1783966755.656077:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783966755.656079:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966755.656443:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966755.656461:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966755.656478:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1783966755.656620:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1783966755.656639:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1783966755.656652:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1783966755.656660:0:6511:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1783966755.656662:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783966755.656984:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1783966755.657202:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1783966755.657230:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1783966755.657405:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1783966755.657424:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1783966755.657484:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:0.0:1783966755.657499:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783966755.657519:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657547:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a25 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657556:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066a9c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657563:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657570:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066af0 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657576:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657583:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657619:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657634:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.657648:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf067b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794048:0@lo:104: 00000100:00100000:0.0:1783966755.657708:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966755.657815:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.657823:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 18 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.657837:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf064e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794176:0@lo:104: 00000100:00100000:0.0:1783966755.657859:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966755.658130:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.658138:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 18 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.658146:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf067800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794304:0@lo:104: 00000100:00100000:0.0:1783966755.658168:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.658190:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794048 00000100:00100000:3.0:1783966755.658196:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794048 00000100:00100000:1.0:1783966755.658247:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794176 00000100:00100000:1.0:1783966755.658252:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794176 00000100:00100000:1.0:1783966755.658284:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783966755.658293:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587794048:12345-0@lo:104: 00010000:00010000:1.0:1783966755.658308:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.658364:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783966755.658370:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587794048:12345-0@lo:104: Request processed in 79us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.658377:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783966755.658446:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966755.658453:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.658460:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966755.658464:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.658472:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966755.658478:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966755.658485:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966755.658513:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.658519:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966755.658538:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.658545:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62c00/0x9269c8b316066b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.658555:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966755.658557:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966755.658559:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966755.658570:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587794432:0@lo:103: 00000100:00100000:2.0:1783966755.658598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.658656:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783966755.658663:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587794176:12345-0@lo:104: 00010000:00010000:1.0:1783966755.658671:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.658710:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783966755.658715:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587794176:12345-0@lo:104: Request processed in 53us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.658721:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783966755.658740:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794432 00000100:00100000:1.0:1783966755.658743:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794432 00010000:00010000:1.0:1783966755.658759:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 19 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966755.658806:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783966755.658813:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+19:3647:x1870624587794432:12345-0@lo:103: 00010000:00010000:1.0:1783966755.658824:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966755.658836:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 19 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.658846:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 19 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.658861:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966755.658890:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+19:3647:x1870624587794432:12345-0@lo:103: Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.658896:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783966755.658926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587794432:0@lo:103: 00010000:00010000:2.0:1783966755.659007:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966755.659018:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.659024:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966755.659026:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.659033:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966755.659038:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966755.659043:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966755.659057:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.659063:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966755.659081:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.659088:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0030200/0x9269c8b316066af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.659098:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966755.659099:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966755.659101:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966755.659141:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783966755.659149:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587794560:0@lo:103: 00000100:00100000:1.0:1783966755.659173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966755.659352:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.659361:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.659369:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794688:0@lo:104: 00000100:00100000:0.0:1783966755.659402:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966755.659423:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.659430:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 18 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.659439:0:6511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794816:0@lo:104: 00000100:00100000:0.0:1783966755.659458:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966755.659466:0:6511:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0180 going to sleep for 11 seconds 00010000:00010000:0.0:1783966755.659477:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c1536800/0x9269c8b316066b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b1a expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.659495:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf067b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794048:0@lo:104: 00000100:00100000:0.0:1783966755.659507:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf064e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794176:0@lo:104: 00000100:00100000:1.0:1783966755.659567:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794304 00000100:00100000:1.0:1783966755.659571:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794304 00000100:00100000:1.0:1783966755.659589:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794688 00000100:00100000:1.0:1783966755.659591:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794688 00000100:00100000:1.0:1783966755.659601:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794816 00000100:00100000:1.0:1783966755.659603:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794816 00000100:00100000:1.0:1783966755.659627:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783966755.659633:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:6511:x1870624587794304:12345-0@lo:104: 00010000:00010000:1.0:1783966755.659642:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659690:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783966755.659695:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:6511:x1870624587794304:12345-0@lo:104: Request processed in 63us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.659701:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783966755.659720:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783966755.659726:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587794688:12345-0@lo:104: 00010000:00010000:1.0:1783966755.659733:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659765:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783966755.659794:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6511:x1870624587794688:12345-0@lo:104: Request processed in 69us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.659800:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783966755.659813:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783966755.659818:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587794816:12345-0@lo:104: 00010000:00010000:1.0:1783966755.659825:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659849:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783966755.659853:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:6511:x1870624587794816:12345-0@lo:104: Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966755.659858:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1783966755.659872:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783966755.659876:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659882:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966755.659885:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659892:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966755.659909:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966755.659914:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966755.659932:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659937:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966755.659953:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659960:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316066ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066adb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659970:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783966755.659973:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659978:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966755.659981:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.659987:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966755.659994:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966755.659999:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966755.660018:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660024:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966755.660030:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660036:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316066a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066aa3 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660044:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966755.660047:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660052:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c1536200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966755.660054:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660061:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966755.660067:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966755.660073:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966755.660082:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660088:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966755.660096:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660113:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1536200/0x9269c8b316066a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066a2c expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.660125:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966755.660127:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966755.660129:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966755.660139:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587794944:0@lo:103: 00000100:00100000:1.0:1783966755.660175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966755.660233:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf067800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794304:0@lo:104: 00000100:00100000:0.0:1783966755.660241:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794688:0@lo:104: 00000100:00100000:0.0:1783966755.660249:0:6511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1870624587794816:0@lo:104: 00010000:00010000:0.0:1783966755.660308:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.660404:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966755.660415:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587795200:0@lo:103: 00000100:00100000:1.0:1783966755.660672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966755.660679:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587795072:0@lo:103: 00000100:00100000:1.0:1783966755.660701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.660790:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794560 00000100:00100000:2.0:1783966755.660795:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794560 00010000:00010000:2.0:1783966755.660820:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 18 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966755.660854:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587794944 00000100:00100000:2.0:1783966755.660857:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587794944 00010000:00010000:2.0:1783966755.660868:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 19 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966755.660880:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783966755.660886:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+19:3647:x1870624587794560:12345-0@lo:103: 00010000:00010000:2.0:1783966755.660907:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966755.660913:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 19 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.660922:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 19 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.660936:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030000/0x9269c8b316066af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066af0 expref: 19 pid: 6512 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.660948:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966755.660975:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3647:x1870624587794560:12345-0@lo:103: Request processed in 89us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.660982:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783966755.660995:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783966755.661000:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+17:3645:x1870624587794944:12345-0@lo:103: 00010000:00010000:2.0:1783966755.661007:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966755.661011:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 17 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.661020:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 17 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.661183:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031000/0x9269c8b316066adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ad4 expref: 17 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.661192:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966755.661215:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+16:3645:x1870624587794944:12345-0@lo:103: Request processed in 215us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.661221:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783966755.661351:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587794944:0@lo:103: 00010000:00010000:1.0:1783966755.661377:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966755.661390:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587794560:0@lo:103: 00000100:00100000:3.0:1783966755.661434:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795072 00000100:00100000:3.0:1783966755.661439:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795072 00010000:00010000:3.0:1783966755.661457:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 16 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.661483:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783966755.661489:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+16:3645:x1870624587795072:12345-0@lo:103: 00010000:00010000:3.0:1783966755.661497:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966755.661501:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 16 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661510:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 16 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661521:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c1537e00/0x9269c8b316066aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066a9c expref: 16 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661530:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966755.661559:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+15:3645:x1870624587795072:12345-0@lo:103: Request processed in 71us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.661565:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783966755.661640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.661697:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795200 00000100:00100000:3.0:1783966755.661700:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795200 00010000:00010000:3.0:1783966755.661714:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 15 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.661738:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783966755.661744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+15:3648:x1870624587795200:12345-0@lo:103: 00010000:00010000:3.0:1783966755.661752:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966755.661756:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 15 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661764:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 15 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661873:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066a25 expref: 15 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661884:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661891:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661904:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661912:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661918:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661925:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661940:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966755.661945:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661952:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661973:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.661983:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966755.662012:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+14:3648:x1870624587795200:12345-0@lo:103: Request processed in 268us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.662019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783966755.662150:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587795072:0@lo:103: 00010000:00010000:2.0:1783966755.662216:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.662224:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.662230:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031400/0x9269c8b316066b60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783966755.662244:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783966755.662833:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587795200:0@lo:103: 00000100:00100000:0.0:1783966755.664357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+13:8425:x1870624587793920:12345-0@lo:253: Request processed in 12014us (12341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.664369:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783966755.664458:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587793920:0@lo:253: 10000000:01000000:3.0:1783966755.664472:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783966755.664476:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783966755.664477:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783966755.664478:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966755.664479:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1783966755.664481:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966755.664482:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966755.664483:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966755.664484:0:8425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783966755.664486:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966755.664487:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783966755.664512:0:8425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05fcff3800 from lustre-OST0000 10000000:01000000:3.0:1783966755.664542:0:8425:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783966755.664545:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783966755.664554:0:8425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 10000000:01000000:3.0:1783966755.664557:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783966755.664603:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.664614:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.664623:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.664641:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795328:0@lo:101: 00000100:00100000:3.0:1783966755.665035:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.665065:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966755.670004:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795328 00000100:00100000:2.0:1783966755.670021:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795328 00000100:00100000:2.0:1783966755.670174:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783966755.670183:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+13:8425:x1870624587795328:12345-0@lo:101: 00010000:00010000:2.0:1783966755.670199:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966755.670416:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630600/0x9269c8b316066b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.670445:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630600/0x9269c8b316066b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b67 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.670471:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630600/0x9269c8b316066b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b67 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.670480:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630600, rc 0) 00000100:00100000:2.0:1783966755.670563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795328:12345-0@lo:101: Request processed in 382us (5529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.670570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783966755.670839:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795328:0@lo:101: 00010000:00010000:3.0:1783966755.671042:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.671055:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.671229:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795456:0@lo:501: 00000100:00100000:3.0:1783966755.671297:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.671385:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.671474:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795456 00000100:00100000:0.0:1783966755.671479:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795456 00000100:00100000:0.0:1783966755.671518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783966755.671525:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795456:12345-0@lo:501: 00000100:00100000:0.0:1783966755.671702:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795456:12345-0@lo:501: Request processed in 177us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783966755.671710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783966755.671832:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795456:0@lo:501: 10000000:01000000:3.0:1783966755.671849:0:8425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783966755.675056:0:8425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783966755.675074:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.675087:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.675109:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.675657:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783966755.675710:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05fcff3800 10000000:01000000:3.0:1783966755.675716:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783966755.675723:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783966755.675726:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783966755.675730:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783966755.675733:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783966755.676000:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966755.676009:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676020:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966755.676025:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676037:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.676055:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966755.676132:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966755.676138:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966755.676161:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676166:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966755.676195:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676202:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066b6e expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676215:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966755.676217:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966755.676218:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966755.676287:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587795712:0@lo:103: 00000100:00100000:2.0:1783966755.676366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.676510:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795712 00000100:00100000:1.0:1783966755.676517:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795712 00000100:00100000:1.0:1783966755.676574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966755.676583:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+14:3648:x1870624587795712:12345-0@lo:103: 00010000:00010000:1.0:1783966755.676596:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966755.676611:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630600/0x9269c8b316066b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066b67 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.676625:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966755.676652:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966755.676665:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+13:3648:x1870624587795712:12345-0@lo:103: Request processed in 82us (298us total) trans 0 rc 0/0 00010000:00010000:3.0:1783966755.676666:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966755.676675:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966755.676721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587795712:0@lo:103: 00000100:00100000:3.0:1783966755.676798:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795584:0@lo:101: 00000100:00100000:3.0:1783966755.677004:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.680877:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966755.681468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795584 00000100:00100000:2.0:1783966755.681480:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795584 00000100:00100000:2.0:1783966755.681550:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783966755.681560:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+13:8425:x1870624587795584:12345-0@lo:101: 00010000:00010000:2.0:1783966755.681576:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966755.681595:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b75 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.681621:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b75 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.681632:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b75 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.681641:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966755.681726:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795584:12345-0@lo:101: Request processed in 167us (4741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.681733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783966755.682187:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795584:0@lo:101: 00010000:00010000:3.0:1783966755.682204:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.682214:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.682382:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795840:0@lo:501: 00000100:00100000:3.0:1783966755.682420:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.682454:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966755.682596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795840 00000100:00100000:2.0:1783966755.682601:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795840 00000100:00100000:2.0:1783966755.682633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783966755.682640:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795840:12345-0@lo:501: 00000100:00100000:2.0:1783966755.682751:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795840:12345-0@lo:501: Request processed in 110us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.682759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783966755.682873:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795840:0@lo:501: 00000100:00100000:1.0:1783966755.682902:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795968:0@lo:503: 00000100:00100000:1.0:1783966755.682944:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.682962:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5840 going to sleep for 11 seconds 00000100:00100000:2.0:1783966755.683007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587795968 00000100:00100000:2.0:1783966755.683012:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587795968 00000100:00100000:2.0:1783966755.683043:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783966755.683050:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795968:12345-0@lo:503: 00000100:00100000:2.0:1783966755.683139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587795968:12345-0@lo:503: Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.683147:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783966755.683288:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587795968:0@lo:503: 00000040:00080000:1.0:1783966755.683530:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783966755.683595:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796096:0@lo:502: 00000100:00100000:1.0:1783966755.683636:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.683657:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.683751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796096 00000100:00100000:3.0:1783966755.683755:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796096 00000100:00100000:3.0:1783966755.683809:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783966755.683816:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587796096:12345-0@lo:502: 00000100:00100000:3.0:1783966755.683895:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587796096:12345-0@lo:502: Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.683901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783966755.685239:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796096:0@lo:502: 00000040:00080000:1.0:1783966755.685491:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783966755.685521:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783966755.685536:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783966755.685550:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783966755.685564:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783966755.685577:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783966755.685610:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796224:0@lo:502: 00000100:00100000:1.0:1783966755.685669:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.685716:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.686756:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796224 00000100:00100000:3.0:1783966755.686765:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796224 00000100:00100000:3.0:1783966755.686850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783966755.686859:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587796224:12345-0@lo:502: 00000100:00100000:3.0:1783966755.687000:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587796224:12345-0@lo:502: Request processed in 141us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.687008:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783966755.688477:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796224:0@lo:502: 00000040:00080000:1.0:1783966755.688583:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783966755.688598:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783966755.689377:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783966755.689386:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1783966755.689399:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966755.689401:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1783966755.689407:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783966755.689425:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a05ee1799c0) 00000020:00000080:1.0:1783966755.689448:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783966755.689454:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783966755.689541:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff3800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783966755.689550:0:8448:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783966755.689557:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b316066b8a 00010000:00010000:1.0:1783966755.699014:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1783966755.699321:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1783966755.702350:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783966755.702691:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1783966755.712411:0:8448:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1783966755.714896:0:8448:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1783966755.724638:0:8448:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783966755.725916:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783966755.725928:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966755.725935:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966755.725948:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783966755.725952:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966755.725957:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966755.725958:0:8448:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783966755.725961:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783966755.725963:0:8448:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783966755.725984:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966755.725986:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966755.725987:0:8448:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783966755.725990:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783966755.728174:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783966755.728224:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783966755.728251:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.728264:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966755.728295:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff3800 from 1 10000000:01000000:0.0:1783966755.728298:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966755.728334:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.728342:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966755.728357:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966755.728380:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796352:0@lo:101: 00000100:00100000:0.0:1783966755.728449:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966755.728500:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.728730:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796352 00000100:00100000:3.0:1783966755.728821:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796352 00000100:00100000:3.0:1783966755.729291:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783966755.729304:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:8425:x1870624587796352:12345-0@lo:101: 00010000:00010000:3.0:1783966755.729319:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966755.729334:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b91 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.729360:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b91 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.729381:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b91 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.729390:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1c00, rc 0) 00000100:00100000:3.0:1783966755.729451:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796352:12345-0@lo:101: Request processed in 151us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.729458:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783966755.729541:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796352:0@lo:101: 00010000:00010000:2.0:1783966755.729559:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.729579:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966755.729693:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796480:0@lo:501: 00000100:00100000:2.0:1783966755.729723:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.735843:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.736896:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796480 00000100:00100000:0.0:1783966755.736908:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796480 00000100:00100000:3.0:1783966755.737075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783966755.737205:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796480:12345-0@lo:501: 00000100:00100000:3.0:1783966755.737390:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796480:12345-0@lo:501: Request processed in 304us (7665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.737397:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966755.737652:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796480:0@lo:501: 00000100:00100000:2.0:1783966755.737705:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796608:0@lo:503: 00000100:00100000:2.0:1783966755.737759:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.737819:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.737839:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796608 00000100:00100000:0.0:1783966755.737844:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796608 00000100:00100000:0.0:1783966755.737883:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783966755.737891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796608:12345-0@lo:503: 00000100:00100000:0.0:1783966755.738327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796608:12345-0@lo:503: Request processed in 436us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.738334:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966755.738404:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796608:0@lo:503: 00000040:00080000:2.0:1783966755.738644:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783966755.738708:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796736:0@lo:502: 00000100:00100000:2.0:1783966755.738744:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.738851:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796736 00000100:00100000:3.0:1783966755.738856:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796736 00000100:00100000:2.0:1783966755.739011:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.739052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783966755.739136:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796736:12345-0@lo:502: 00000100:00100000:3.0:1783966755.739229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796736:12345-0@lo:502: Request processed in 96us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.739237:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783966755.739307:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796736:0@lo:502: 00000040:00080000:2.0:1783966755.739498:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783966755.739524:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783966755.739546:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796864:0@lo:502: 00000100:00100000:2.0:1783966755.739580:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.739726:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.739834:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796864 00000100:00100000:0.0:1783966755.739839:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796864 00000100:00100000:0.0:1783966755.739863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783966755.739869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796864:12345-0@lo:502: 00000100:00100000:0.0:1783966755.739969:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796864:12345-0@lo:502: Request processed in 99us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.739981:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783966755.740015:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796864:0@lo:502: 00000040:00080000:0.0:1783966755.740248:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783966755.740261:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783966755.740685:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966755.740694:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966755.740696:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783966755.740702:0:8452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05fcff3800 00000020:00000080:0.0:1783966755.740704:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783966755.740715:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966755.740717:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966755.740718:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783966755.740720:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783966755.740888:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783966755.740928:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783966755.740955:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.740972:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966755.741022:0:8425:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783966755.741025:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05fcff3800 10000000:01000000:2.0:1783966755.741028:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05fcff3800 10000000:01000000:2.0:1783966755.741032:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783966755.741038:0:8425:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05fcff3800 from 1 10000000:01000000:2.0:1783966755.741040:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783966755.741080:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.741088:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.741099:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966755.741115:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796992:0@lo:101: 00000100:00100000:2.0:1783966755.741154:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.741178:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.741180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587796992 00000100:00100000:3.0:1783966755.741185:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587796992 00000100:00100000:3.0:1783966755.741208:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783966755.741215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:8425:x1870624587796992:12345-0@lo:101: 00010000:00010000:3.0:1783966755.741225:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966755.741236:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066b9f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.741575:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066b9f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.741589:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b9f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.741598:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:3.0:1783966755.741642:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587796992:12345-0@lo:101: Request processed in 427us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.741649:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783966755.741727:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587796992:0@lo:101: 00010000:00010000:2.0:1783966755.741740:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.741749:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966755.742129:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797120:0@lo:501: 00000100:00100000:2.0:1783966755.742158:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.742225:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.742258:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797120 00000100:00100000:0.0:1783966755.742262:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797120 00000100:00100000:0.0:1783966755.742307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783966755.742314:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797120:12345-0@lo:501: 00000100:00100000:0.0:1783966755.742458:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797120:12345-0@lo:501: Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.742465:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783966755.742544:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797120:0@lo:501: 00000100:00100000:2.0:1783966755.742568:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797248:0@lo:503: 00000100:00100000:2.0:1783966755.742604:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.742623:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.742672:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797248 00000100:00100000:3.0:1783966755.742676:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797248 00000100:00100000:3.0:1783966755.742734:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783966755.742741:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797248:12345-0@lo:503: 00000100:00100000:3.0:1783966755.742855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797248:12345-0@lo:503: Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.742862:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783966755.742960:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797248:0@lo:503: 00000040:00080000:1.0:1783966755.743214:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783966755.743267:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797376:0@lo:502: 00000100:00100000:1.0:1783966755.743314:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.744227:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.744332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797376 00000100:00100000:0.0:1783966755.744338:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797376 00000100:00100000:0.0:1783966755.744368:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783966755.744374:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797376:12345-0@lo:502: 00000100:00100000:0.0:1783966755.744496:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797376:12345-0@lo:502: Request processed in 122us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.744503:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783966755.744601:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797376:0@lo:502: 00000040:00080000:1.0:1783966755.744825:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783966755.744851:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783966755.744865:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783966755.744878:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783966755.744890:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783966755.744902:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783966755.744930:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783966755.745193:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783966755.745224:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783966755.745236:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783966755.745246:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783966755.745255:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783966755.745267:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783966755.745291:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783966755.745304:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783966755.745317:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783966755.745330:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783966755.745342:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783966755.745352:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783966755.745362:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783966755.745371:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783966755.745380:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783966755.745389:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783966755.745399:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783966755.745421:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1783966755.745435:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1783966755.745446:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1783966755.745455:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1783966755.745465:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1783966755.745476:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1783966755.745485:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1783966755.745494:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1783966755.745503:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1783966755.745513:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1783966755.745526:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1783966755.745538:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1783966755.745548:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1783966755.745584:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797504:0@lo:502: 00000100:00100000:1.0:1783966755.745639:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.745671:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5600 going to sleep for 11 seconds 00000100:00100000:0.0:1783966755.745757:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797504 00000100:00100000:0.0:1783966755.745766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797504 00000100:00100000:0.0:1783966755.745819:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783966755.745827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797504:12345-0@lo:502: 00000100:00100000:0.0:1783966755.745966:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587797504:12345-0@lo:502: Request processed in 140us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.745974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783966755.746260:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587797504:0@lo:502: 00000040:00080000:1.0:1783966755.746317:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1783966755.746327:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783966755.746743:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783966755.746791:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a04c1fdcd40) 00000020:00000080:1.0:1783966755.746813:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783966755.747191:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783966755.747196:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783966755.747199:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff3800 3 00010000:00080000:1.0:1783966755.747228:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1f69000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783966755.755678:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1783966755.757423:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783966755.757693:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783966755.757707:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9269c8b316066bb4 00000100:00080000:1.0:1783966755.757719:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783966755.757725:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a04c1f69000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783966755.760173:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1cf5880 x1870624587797632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783966755.760205:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783966755.760317:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587797632:0@lo:38: 00000100:00100000:2.0:1783966755.760389:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966755.761023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797632 00000100:00100000:1.0:1783966755.761032:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797632 00000100:00100000:1.0:1783966755.761421:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783966755.761430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587797632:12345-0@lo:38: 00010000:00080000:1.0:1783966755.761456:0:6519:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:1.0:1783966755.761517:0:6519:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9269c8b316066bbb 00000004:00100000:1.0:1783966755.761534:0:6519:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783966755.761565:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a04c253a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966755.761638:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870624587797632:12345-0@lo:38: Request processed in 208us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.761643:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587797760:0@lo:400: 00000100:00100000:1.0:1783966755.761658:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783966755.761687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966755.761710:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1cf5880 x1870624587797632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966755.761716:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966755.761724:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966755.761731:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783966755.761738:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783966755.761742:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783966755.761745:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783966755.761751:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587797632:0@lo:38: 00000100:00100000:0.0:1783966755.761850:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797760 00000100:00100000:0.0:1783966755.761855:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797760 00000100:00100000:0.0:1783966755.761893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783966755.761900:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587797760:12345-0@lo:400: 00000100:00100000:3.0:1783966755.761973:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587797888:0@lo:400: 00000100:00100000:3.0:1783966755.762005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783966755.762037:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f1abb480 x1870624587797760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966755.762049:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587797760:0@lo:400: 00000100:00100000:3.0:1783966755.762078:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587798144:0@lo:400: 00000100:00100000:3.0:1783966755.762110:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.762140:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966755.762146:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587798016:0@lo:400: 00000100:00100000:3.0:1783966755.762221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.762227:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587797888 00000100:00100000:2.0:1783966755.762233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587797888 00000100:00100000:3.0:1783966755.762256:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798016 00000100:00100000:2.0:1783966755.762261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798144 00000100:00100000:3.0:1783966755.762262:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798016 00000100:00100000:2.0:1783966755.762267:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798144 00000100:00100000:2.0:1783966755.762300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783966755.762311:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966755.762311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587797888:12345-0@lo:400: 00000100:00100000:3.0:1783966755.762324:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587798016:12345-0@lo:400: 00000100:00100000:2.0:1783966755.762367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587797888:12345-0@lo:400: Request processed in 59us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.762375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783966755.762380:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587798016:12345-0@lo:400: Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.762388:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966755.762393:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966755.762402:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587798144:12345-0@lo:400: 00010000:00080000:3.0:1783966755.762441:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f1abb800 x1870624587798016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966755.762451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587797760:12345-0@lo:400: Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.762454:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587798016:0@lo:400: 00000100:00100000:0.0:1783966755.762468:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:01000004:1.0:1783966755.763078:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783966755.763098:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a04c1fd99c0) 00000020:00000080:1.0:1783966755.763185:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1783966755.763354:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783966755.763359:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff3800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783966755.763361:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff3800 3 00010000:00080000:1.0:1783966755.763404:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c253e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.159@tcp at head 00000100:00100000:2.0:1783966755.765948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587798144:12345-0@lo:400: Request processed in 3539us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966755.765965:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783966755.766021:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587798144:0@lo:400: 00000100:00100000:3.0:1783966755.766074:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587797888:0@lo:400: 00010000:00010000:1.0:1783966755.770573:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1783966755.770678:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1783966755.770723:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783966755.771228:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9269c8b316066bc9 00000100:00080000:1.0:1783966755.771240:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783966755.771246:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a04c253e800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783966755.771360:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1cf5880 x1870624587798272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783966755.771418:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587798272:0@lo:38: 00000100:00100000:2.0:1783966755.771506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783966755.771583:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1783966755.771631:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798272 00000100:00100000:0.0:1783966755.771639:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798272 00000100:00100000:0.0:1783966755.771683:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783966755.771693:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587798272:12345-0@lo:38: 00010000:00080000:0.0:1783966755.771718:0:7847:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1783966755.771757:0:7847:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9269c8b316066bd0 00000040:00080000:1.0:1783966755.772127:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1783966755.772330:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1783966755.772362:0:8425:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783966755.772380:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966755.772391:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783966755.772438:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783966755.772441:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783966755.772442:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966755.772443:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966755.772445:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966755.772446:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966755.772448:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783966755.772449:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966755.772450:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966755.772452:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966755.772453:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783966755.772457:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783966755.772460:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783966755.772461:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783966755.772462:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966755.772463:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966755.772464:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966755.772465:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966755.772466:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783966755.772467:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966755.772468:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966755.772469:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966755.772470:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783966755.772483:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783966755.772496:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587798400:0@lo:253: 00000100:00100000:2.0:1783966755.772537:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966755.772565:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b600 going to sleep for 11 seconds 00000004:00100000:0.0:1783966755.772654:0:7847:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783966755.772689:0:7847:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7a000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1783966755.773152:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1cf5880 x1870624587798272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966755.773164:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783966755.773171:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783966755.773178:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783966755.773183:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783966755.773185:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c253e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783966755.773191:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587798272:0@lo:38: 00000100:00100000:0.0:1783966755.773239:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870624587798272:12345-0@lo:38: Request processed in 1547us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.773248:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783966755.773360:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798400 00000100:00100000:0.0:1783966755.773365:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798400 00000100:00100000:0.0:1783966755.773428:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783966755.773436:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587798400:12345-0@lo:253: 20000000:01000000:0.0:1783966755.773465:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783966755.773479:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783966755.780282:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783966755.780310:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783966755.780431:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783966755.780438:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783966755.780462:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780480:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780488:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780509:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780547:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780565:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 16 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.780579:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1aba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587798528:0@lo:104: 00000100:00100000:3.0:1783966755.780628:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966755.780653:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:8425:x1870624587798400:12345-0@lo:253: Request processed in 7215us (8113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966755.780665:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1783966755.780672:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780680:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.780686:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587798656:0@lo:104: 00000100:00100000:3.0:1783966755.780703:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966755.780743:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783966755.780762:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.780812:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798528 00000100:00100000:3.0:1783966755.780820:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798528 00000100:00100000:1.0:1783966755.780830:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798656 00000100:00100000:1.0:1783966755.780835:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798656 00000100:00100000:3.0:1783966755.780859:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783966755.780868:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f560f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587798528:12345-0@lo:104: 00010000:00010000:3.0:1783966755.780879:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.780944:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966755.780949:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f560f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587798528:12345-0@lo:104: Request processed in 84us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.780956:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783966755.780989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966755.780994:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587798656:12345-0@lo:104: 00010000:00010000:3.0:1783966755.781000:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781028:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783966755.781032:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6534:x1870624587798656:12345-0@lo:104: Request processed in 39us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.781037:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783966755.781051:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783966755.781057:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781063:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966755.781066:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781074:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966755.781080:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966755.781085:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966755.781118:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781124:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966755.781138:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781144:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781155:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966755.781157:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781163:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966755.781165:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781171:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966755.781178:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966755.781183:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783966755.781194:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781200:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966755.781205:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781220:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602178400/0x9269c8b316066ac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781231:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966755.781233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966755.781235:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966755.781242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966755.781259:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587798784:0@lo:103: 00000100:00100000:3.0:1783966755.781299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.781325:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966755.781331:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587798912:0@lo:103: 00000100:00100000:3.0:1783966755.781365:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966755.781420:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798784 00000100:00100000:3.0:1783966755.781424:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798784 00010000:00010000:3.0:1783966755.781447:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 17 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.781468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587798912 00000100:00100000:3.0:1783966755.781471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587798912 00010000:00010000:3.0:1783966755.781480:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 18 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.781491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783966755.781497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+18:3645:x1870624587798784:12345-0@lo:103: 00010000:00010000:3.0:1783966755.781506:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966755.781510:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781529:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781545:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966755.781563:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030400/0x9269c8b316066ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ae2 expref: 18 pid: 6511 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966755.781577:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1aba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587798528:0@lo:104: 00000100:00100000:3.0:1783966755.781580:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+17:3645:x1870624587798784:12345-0@lo:103: Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.781589:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783966755.781594:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587798656:0@lo:104: 00000100:00100000:3.0:1783966755.781608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966755.781617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+16:3645:x1870624587798912:12345-0@lo:103: 00010000:00010000:1.0:1783966755.781619:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781626:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966755.781632:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781641:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781649:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031600/0x9269c8b316066acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ac6 expref: 16 pid: 6510 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781659:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781666:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783966755.781677:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009497774s 00010000:00010000:3.0:1783966755.781681:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781697:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781704:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781710:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781716:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966755.781720:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781729:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781749:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966755.781758:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966755.781994:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+15:3645:x1870624587798912:12345-0@lo:103: Request processed in 378us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966755.782001:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783966755.782239:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:8425:1870624587798400:0@lo:253: 10000000:01000000:2.0:1783966755.782251:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783966755.782254:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783966755.782257:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783966755.782258:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783966755.782260:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783966755.782261:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783966755.782263:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783966755.782265:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783966755.782266:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783966755.782268:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783966755.782269:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783966755.782271:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783966755.782357:0:8425:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1783966755.783304:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.783317:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966755.783325:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0800/0x9269c8b316066bd7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966755.785914:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587798912:0@lo:103: 00000100:00100000:3.0:1783966755.785930:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1aba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587798784:0@lo:103: 00080000:10000000:3.0:1783966755.789488:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783966755.794199:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783966755.794490:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783966755.794652:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783966755.794920:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783966755.795137:0:8425:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1783966755.797573:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783966755.819521:0:8425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1783966755.819531:0:8425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1783966755.819575:0:8425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783966755.819626:0:8425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783966755.819706:0:8425:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1783966755.819731:0:8425:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1783966755.822243:0:8425:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966755.822430:0:8425:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783966755.902307:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966756.215056:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587799040:0@lo:41: 00000100:00100000:0.0:1783966756.215131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966756.215209:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799040 00000100:00100000:3.0:1783966756.215217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799040 00000100:00100000:3.0:1783966756.215284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783966756.215294:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587799040:12345-0@lo:41: 00000004:00000024:3.0:1783966756.215324:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1783966756.215381:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587799040:12345-0@lo:41: Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966756.215389:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783966756.215444:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587799040:0@lo:41: 00000020:00000004:1.0:1783966756.800511:0:8509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966756.800705:0:8509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783966756.926277:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966757.952553:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966758.966873:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966759.287105:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587799168:0@lo:41: 00000100:00100000:1.0:1783966759.287184:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966759.288025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799168 00000100:00100000:3.0:1783966759.288035:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799168 00000100:00100000:3.0:1783966759.288247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783966759.288258:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587799168:12345-0@lo:41: 00000004:00000024:3.0:1783966759.288298:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783966759.288455:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587799168:12345-0@lo:41: Request processed in 198us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966759.288464:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783966759.288545:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587799168:0@lo:41: 00010000:00010000:0.0:1783966759.992164:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783966760.822876:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783966760.822885:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f1a14000 from 30 10000000:01000000:3.0:1783966760.822890:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966760.822941:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.822953:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.822975:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.823001:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799296:0@lo:101: 00000100:00100000:3.0:1783966760.823074:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.823119:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.823155:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799296 00000100:00100000:3.0:1783966760.823162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799296 00000100:00100000:3.0:1783966760.823219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783966760.823228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:6515:x1870624587799296:12345-0@lo:101: 00010000:00010000:3.0:1783966760.823242:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.823255:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066bde expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.823293:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066bde expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.823304:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bde expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.823313:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0200, rc 0) 00000100:00100000:3.0:1783966760.823350:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799296:12345-0@lo:101: Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.823357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783966760.823402:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799296:0@lo:101: 00010000:00010000:3.0:1783966760.823417:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.823426:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.823481:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799424:0@lo:501: 00000100:00100000:3.0:1783966760.823506:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.823523:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.823535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799424 00000100:00100000:3.0:1783966760.823545:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799424 00000100:00100000:3.0:1783966760.823584:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783966760.823591:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799424:12345-0@lo:501: 00000100:00100000:3.0:1783966760.823713:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799424:12345-0@lo:501: Request processed in 122us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.823720:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783966760.823750:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799424:0@lo:501: 00000100:00100000:3.0:1783966760.823802:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799552:0@lo:503: 00000100:00100000:3.0:1783966760.823840:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.823855:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.823867:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799552 00000100:00100000:3.0:1783966760.823872:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799552 00000100:00100000:3.0:1783966760.823894:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783966760.823900:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799552:12345-0@lo:503: 00000100:00100000:3.0:1783966760.823981:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799552:12345-0@lo:503: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.823988:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783966760.824031:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799552:0@lo:503: 00000100:00100000:3.0:1783966760.824227:0:8703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8703:1870624587799680:0@lo:502: 00000100:00100000:3.0:1783966760.824259:0:8703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.824279:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799680 00000100:00100000:3.0:1783966760.824283:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799680 00000100:00100000:3.0:1783966760.824304:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783966760.824310:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8703:x1870624587799680:12345-0@lo:502: 00000100:00100000:3.0:1783966760.824378:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8703:x1870624587799680:12345-0@lo:502: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.824393:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783966760.824421:0:8703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.824432:0:8703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8703:1870624587799680:0@lo:502: 00000100:00100000:3.0:1783966760.824467:0:8703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8703:1870624587799808:0@lo:502: 00000100:00100000:3.0:1783966760.824500:0:8703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.824516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799808 00000100:00100000:3.0:1783966760.824520:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799808 00000100:00100000:3.0:1783966760.824539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783966760.824545:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8703:x1870624587799808:12345-0@lo:502: 00000100:00100000:3.0:1783966760.824599:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:8703:x1870624587799808:12345-0@lo:502: Request processed in 54us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.824605:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783966760.824628:0:8703:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.824638:0:8703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8703:1870624587799808:0@lo:502: 00000040:00080000:3.0:1783966760.824653:0:8703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1783966760.824700:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1783966760.824719:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783966760.824726:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824736:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966760.824743:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783966760.824745:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05f1a14000 from 5 10000000:01000000:3.0:1783966760.824748:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783966760.824766:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824799:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824808:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.824819:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799936:0@lo:101: 00000100:00100000:3.0:1783966760.824841:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.824853:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.824862:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587799936 00000100:00100000:3.0:1783966760.824865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587799936 00000100:00100000:3.0:1783966760.824881:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783966760.824886:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587799936:12345-0@lo:101: 00010000:00010000:3.0:1783966760.824892:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.824902:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066bec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824916:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066bec expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824924:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bec expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.824932:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0600, rc 0) 00000100:00100000:3.0:1783966760.824955:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587799936:12345-0@lo:101: Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.824960:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783966760.824986:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587799936:0@lo:101: 00010000:00010000:3.0:1783966760.825002:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825009:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.825046:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800064:0@lo:256: 00000100:00100000:3.0:1783966760.825074:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.825086:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.825097:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800064 00000100:00100000:3.0:1783966760.825100:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800064 00000100:00100000:3.0:1783966760.825119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783966760.825125:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587800064:12345-0@lo:256: 20000000:01000000:3.0:1783966760.825137:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783966760.825153:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783966760.825156:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1783966760.825247:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587800064:12345-0@lo:256: Request processed in 121us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.825254:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783966760.825283:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800064:0@lo:256: 10000000:01000000:3.0:1783966760.825332:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783966760.825338:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825345:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966760.825351:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783966760.825357:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1783966760.825359:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783966760.825372:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825379:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825386:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.825396:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800192:0@lo:101: 00000100:00100000:3.0:1783966760.825418:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.825429:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.825438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800192 00000100:00100000:3.0:1783966760.825441:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800192 00000100:00100000:3.0:1783966760.825457:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783966760.825462:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587800192:12345-0@lo:101: 00010000:00010000:3.0:1783966760.825468:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.825475:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066bfa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825488:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066bfa expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825496:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bfa expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825502:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:3.0:1783966760.825524:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587800192:12345-0@lo:101: Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.825534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783966760.825559:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800192:0@lo:101: 00010000:00010000:3.0:1783966760.825568:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.825575:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.825611:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800320:0@lo:501: 00000100:00100000:3.0:1783966760.825631:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.825641:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.825649:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800320 00000100:00100000:3.0:1783966760.825651:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800320 00000100:00100000:3.0:1783966760.825666:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783966760.825671:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587800320:12345-0@lo:501: 00000100:00100000:3.0:1783966760.825749:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587800320:12345-0@lo:501: Request processed in 77us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.825755:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783966760.825800:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800320:0@lo:501: 00000100:00100000:3.0:1783966760.825819:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800448:0@lo:503: 00000100:00100000:3.0:1783966760.825849:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.825859:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.825868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800448 00000100:00100000:3.0:1783966760.825871:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800448 00000100:00100000:3.0:1783966760.825887:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783966760.825892:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587800448:12345-0@lo:503: 00000100:00100000:3.0:1783966760.825956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587800448:12345-0@lo:503: Request processed in 62us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.825962:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783966760.826007:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587800448:0@lo:503: 00000100:00100000:0.0:1783966760.826917:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587800832:0@lo:400: 00000100:00100000:0.0:1783966760.827990:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966760.828030:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966760.828037:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587800960:0@lo:400: 00000100:00100000:0.0:1783966760.828076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966760.828457:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800832 00000100:00100000:1.0:1783966760.828481:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800832 00000100:00100000:1.0:1783966760.828525:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783966760.828533:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587800832:12345-0@lo:400: 00000100:00100000:1.0:1783966760.828606:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587800832:12345-0@lo:400: Request processed in 74us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966760.828613:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783966760.828805:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587800576:0@lo:400: 00000100:00100000:3.0:1783966760.828836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.828855:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587801088:0@lo:400: 00000100:00100000:3.0:1783966760.828875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.828891:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783966760.828897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587800704:0@lo:400: 00000100:00100000:3.0:1783966760.828914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.828927:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587801216:0@lo:400: 00000100:00100000:3.0:1783966760.828946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.828979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800576 00000100:00100000:3.0:1783966760.828983:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800576 00000100:00100000:3.0:1783966760.828999:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801088 00000100:00100000:3.0:1783966760.829002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801088 00000100:00100000:3.0:1783966760.829018:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801216 00000100:00100000:3.0:1783966760.829020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801216 00000100:00100000:3.0:1783966760.829032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966760.829037:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587800576:12345-0@lo:400: 00000100:00100000:3.0:1783966760.829069:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587800576:12345-0@lo:400: Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.829075:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966760.829086:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966760.829092:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587801088:12345-0@lo:400: 00000100:00100000:3.0:1783966760.829128:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587801088:12345-0@lo:400: Request processed in 36us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.829134:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966760.829145:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783966760.829151:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587801216:12345-0@lo:400: 00000100:00100000:3.0:1783966760.829174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587801216:12345-0@lo:400: Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.829190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783966760.829214:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800960 00000100:00100000:3.0:1783966760.829217:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800960 00000100:00100000:3.0:1783966760.829233:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587800704 00000100:00100000:3.0:1783966760.829236:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587800704 00000100:00100000:3.0:1783966760.829247:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966760.829253:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587800960:12345-0@lo:400: 00000100:00100000:3.0:1783966760.829284:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587800960:12345-0@lo:400: Request processed in 31us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.829290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966760.829301:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783966760.829307:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587800704:12345-0@lo:400: 00000100:00100000:3.0:1783966760.829331:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587800704:12345-0@lo:400: Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.829336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783966760.829354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966760.829358:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966760.829384:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587800704:0@lo:400: 00010000:00080000:3.0:1783966760.829396:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf5f80 x1870624587801216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.829420:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587801216:0@lo:400: 00010000:00080000:3.0:1783966760.829432:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf7800 x1870624587800576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.829440:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587800576:0@lo:400: 00010000:00080000:3.0:1783966760.829447:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf4e00 x1870624587801088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.829454:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587801088:0@lo:400: 00000100:00100000:1.0:1783966760.829832:0:8704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8704:1870624587801344:0@lo:502: 00000100:00100000:1.0:1783966760.829876:0:8704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966760.829903:0:8704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.830060:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801344 00000100:00100000:2.0:1783966760.830065:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801344 00000100:00100000:2.0:1783966760.830096:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783966760.830104:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8704:x1870624587801344:12345-0@lo:502: 00000100:00100000:2.0:1783966760.830222:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8704:x1870624587801344:12345-0@lo:502: Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.830229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783966760.830339:0:8704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8704:1870624587801344:0@lo:502: 00000020:01000000:1.0:1783966760.830364:0:8704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783966760.830372:0:8704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783966760.830380:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966760.830382:0:8704:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783966760.830388:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783966760.830391:0:8704:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1783966760.830416:0:8704:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783966760.830419:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783966760.830432:0:8704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a04c1fd8000) 00000020:00000080:1.0:1783966760.830452:0:8704:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1783966760.830458:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783966760.830539:0:8704:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1783966760.830546:0:8704:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783966760.830553:0:8704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316066c0f 00010000:00080000:1.0:1783966760.830654:0:8704:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1f6d000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783966760.830906:0:8704:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:0.0:1783966760.831799:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587800960:0@lo:400: 00010000:00080000:0.0:1783966760.831818:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf5500 x1870624587800832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.831829:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587800832:0@lo:400: 00000040:01000000:1.0:1783966760.838733:0:8704:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783966760.838761:0:8704:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783966760.839010:0:8704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966760.839274:0:8704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966760.839364:0:8704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783966760.839453:0:8704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783966760.840003:0:8705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783966760.840009:0:8705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783966760.840721:0:8704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783966760.840734:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783966760.840803:0:8704:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783966760.840829:0:8704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066c16 00000100:00080000:2.0:1783966760.840842:0:8704:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783966760.840848:0:8704:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a04c1f6d000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966760.840885:0:8704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f1a26300 x1870624587801472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783966760.840903:0:8704:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783966760.840985:0:8704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966760.840990:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966760.840992:0:8704:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783966760.840995:0:8704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966760.840999:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966760.841001:0:8704:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783966760.841004:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783966760.841006:0:8704:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783966760.841033:0:8704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8704:1870624587801600:0@lo:502: 00000100:00100000:2.0:1783966760.841113:0:8704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.841152:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801600 00000100:00100000:2.0:1783966760.841158:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801600 00000100:00100000:2.0:1783966760.841221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783966760.841230:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8704:x1870624587801600:12345-0@lo:502: 00000100:00100000:2.0:1783966760.841336:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:8704:x1870624587801600:12345-0@lo:502: Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.841343:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783966760.841391:0:8704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.841411:0:8704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8704:1870624587801600:0@lo:502: 00000020:01000000:2.0:1783966760.841439:0:8704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966760.841443:0:8704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966760.841445:0:8704:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783966760.841448:0:8704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1783966760.841758:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587801472:0@lo:8: 00000100:00100000:1.0:1783966760.841824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.841912:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801472 00000100:00100000:2.0:1783966760.841917:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801472 00000100:00100000:2.0:1783966760.841938:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966760.841943:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624587801472:12345-0@lo:8: 00010000:00080000:2.0:1783966760.842026:0:8432:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1783966760.842050:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066c1d 00002000:00100000:2.0:1783966760.842080:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c1c8f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1783966760.842084:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1783966760.842088:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783966760.842142:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783966760.842639:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1783966760.842664:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a04c1c8c000 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1783966760.842911:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1783966760.842946:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783966760.842967:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.842978:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966760.842988:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783966760.842991:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ed1cf800 from 30 10000000:01000000:3.0:1783966760.842994:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966760.843023:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843032:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843041:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.843071:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801728:0@lo:101: 00000100:00100000:3.0:1783966760.843105:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.843133:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.843150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801728 00000100:00100000:3.0:1783966760.843155:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801728 00000100:00100000:3.0:1783966760.843204:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783966760.843213:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587801728:12345-0@lo:101: 00010000:00010000:3.0:1783966760.843223:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.843236:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c24 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843259:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c24 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843270:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c24 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843279:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1800, rc 0) 00000100:00100000:3.0:1783966760.843310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587801728:12345-0@lo:101: Request processed in 98us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.843318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783966760.843359:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801728:0@lo:101: 00010000:00010000:3.0:1783966760.843372:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.843380:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.843442:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801856:0@lo:501: 00000100:00100000:3.0:1783966760.843467:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.843482:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.843718:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587801472:12345-0@lo:8: Request processed in 1773us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.843727:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966760.843752:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801856 00000100:00100000:2.0:1783966760.843763:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801856 00000100:00100000:2.0:1783966760.843813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783966760.843820:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587801856:12345-0@lo:501: 00000100:00100000:2.0:1783966760.843944:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587801856:12345-0@lo:501: Request processed in 123us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.843951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783966760.843993:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801856:0@lo:501: 00000100:00100000:2.0:1783966760.844020:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801984:0@lo:503: 00000100:00100000:2.0:1783966760.844058:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.844071:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.844081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587801984 00000100:00100000:2.0:1783966760.844084:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587801984 00000100:00100000:2.0:1783966760.844100:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783966760.844106:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587801984:12345-0@lo:503: 00000100:00100000:2.0:1783966760.844195:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587801984:12345-0@lo:503: Request processed in 87us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.844202:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783966760.844240:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587801984:0@lo:503: 00000100:00100000:2.0:1783966760.844424:0:8707:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8707:1870624587802112:0@lo:502: 00000100:00100000:2.0:1783966760.844457:0:8707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.844475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802112 00000100:00100000:2.0:1783966760.844478:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802112 00000100:00100000:2.0:1783966760.844499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783966760.844505:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8707:x1870624587802112:12345-0@lo:502: 00000100:00100000:2.0:1783966760.844710:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8707:x1870624587802112:12345-0@lo:502: Request processed in 204us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.844726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783966760.844755:0:8707:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.844767:0:8707:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8707:1870624587802112:0@lo:502: 00000100:00100000:2.0:1783966760.844826:0:8707:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8707:1870624587802240:0@lo:502: 00000100:00100000:2.0:1783966760.844858:0:8707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.844875:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802240 00000100:00100000:2.0:1783966760.844879:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802240 00000100:00100000:2.0:1783966760.844897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783966760.844903:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8707:x1870624587802240:12345-0@lo:502: 00000100:00100000:2.0:1783966760.844972:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:8707:x1870624587802240:12345-0@lo:502: Request processed in 68us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.844978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783966760.845005:0:8707:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.845016:0:8707:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8707:1870624587802240:0@lo:502: 00000040:00080000:2.0:1783966760.845032:0:8707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783966760.845084:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783966760.845108:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783966760.845116:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845126:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966760.845134:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783966760.845136:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05ed1cf800 from 5 10000000:01000000:2.0:1783966760.845139:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783966760.845158:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845171:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845197:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966760.845209:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802368:0@lo:101: 00000100:00100000:2.0:1783966760.845234:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.845246:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.845257:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802368 00000100:00100000:2.0:1783966760.845260:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802368 00000100:00100000:2.0:1783966760.845280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966760.845286:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587802368:12345-0@lo:101: 00010000:00010000:2.0:1783966760.845294:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966760.845304:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845321:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c32 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845332:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c32 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845340:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783966760.845369:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587802368:12345-0@lo:101: Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.845375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966760.845404:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802368:0@lo:101: 00010000:00010000:2.0:1783966760.845423:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845432:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966760.845472:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802496:0@lo:256: 00000100:00100000:2.0:1783966760.845502:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.845514:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.845524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802496 00000100:00100000:2.0:1783966760.845527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802496 00000100:00100000:2.0:1783966760.845546:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783966760.845551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587802496:12345-0@lo:256: 20000000:01000000:2.0:1783966760.845698:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783966760.845714:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783966760.845718:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783966760.845813:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587802496:12345-0@lo:256: Request processed in 261us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.845821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783966760.845850:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802496:0@lo:256: 10000000:01000000:2.0:1783966760.845887:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783966760.845893:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845901:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966760.845908:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783966760.845914:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783966760.845917:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783966760.845931:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845938:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.845946:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966760.846314:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802624:0@lo:101: 00000100:00100000:2.0:1783966760.846345:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.846373:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bd80 going to sleep for 11 seconds 00010000:00080000:1.0:1783966760.846525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f1a26300 x1870624587801472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783966770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966760.846536:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966760.846544:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783966760.846552:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783966760.846633:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783966760.846638:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783966760.846651:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783966760.846657:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587801472:0@lo:8: 00000004:00080000:1.0:1783966760.846684:0:8705:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783966760.846750:0:8705:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 237047979757ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783966760.846756:0:8705:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783966760.846815:0:8706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587802752:0@lo:700: 00000100:00100000:1.0:1783966760.846845:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966760.846860:0:8706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff5540 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.846938:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802624 00000100:00100000:3.0:1783966760.846944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802624 00000100:00100000:3.0:1783966760.847045:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783966760.847054:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587802624:12345-0@lo:101: 00010000:00010000:3.0:1783966760.847065:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.847078:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c40 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.847097:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c40 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.847109:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c40 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.847117:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0a00, rc 0) 00000100:00100000:3.0:1783966760.847152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587802624:12345-0@lo:101: Request processed in 100us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.847159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783966760.847204:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802624:0@lo:101: 00010000:00010000:3.0:1783966760.847217:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.847227:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.847293:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802880:0@lo:501: 00000100:00100000:3.0:1783966760.847320:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.847333:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.847346:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802880 00000100:00100000:3.0:1783966760.847349:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802880 00000100:00100000:3.0:1783966760.847369:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783966760.847375:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587802880:12345-0@lo:501: 00000100:00100000:3.0:1783966760.847479:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587802880:12345-0@lo:501: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.847487:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783966760.847514:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587802880:0@lo:501: 00000100:00100000:3.0:1783966760.847538:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803008:0@lo:503: 00000100:00100000:3.0:1783966760.848064:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.848080:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.848092:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803008 00000100:00100000:3.0:1783966760.848096:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803008 00000100:00100000:3.0:1783966760.848116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783966760.848122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587803008:12345-0@lo:503: 00000100:00100000:3.0:1783966760.848218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587803008:12345-0@lo:503: Request processed in 95us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.848225:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783966760.848264:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803008:0@lo:503: 00000100:00100000:1.0:1783966760.848878:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587802752 00000100:00100000:1.0:1783966760.848884:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587802752 00000100:00100000:1.0:1783966760.848925:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966760.848933:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8706:x1870624587802752:12345-0@lo:700: 00000100:00100000:1.0:1783966760.849050:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1870624587803136:0@lo:700: 00000100:00100000:1.0:1783966760.849096:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966760.849116:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966760.849134:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803136 00000100:00100000:1.0:1783966760.849137:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803136 00000100:00100000:1.0:1783966760.849171:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966760.849188:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1870624587803136:12345-0@lo:700: 00000100:00080000:3.0:1783966760.849849:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966760.850820:0:8708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8708:1870624587803264:0@lo:502: 00000100:00100000:2.0:1783966760.850891:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.850921:0:8708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b000 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.851054:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803264 00000100:00100000:3.0:1783966760.851066:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803264 00000100:00100000:3.0:1783966760.851111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783966760.851120:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:8708:x1870624587803264:12345-0@lo:502: 00000100:00100000:3.0:1783966760.851248:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:8708:x1870624587803264:12345-0@lo:502: Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.851256:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783966760.852308:0:8708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8708:1870624587803264:0@lo:502: 00000020:01000000:2.0:1783966760.852348:0:8708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783966760.852356:0:8708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783966760.852364:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966760.852366:0:8708:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783966760.852371:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783966760.852375:0:8708:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:2.0:1783966760.852400:0:8708:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783966760.852403:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783966760.852420:0:8708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a05f55f3380) 00000020:00000080:2.0:1783966760.852446:0:8708:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1783966760.852452:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783966760.852576:0:8708:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783966760.852583:0:8708:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783966760.852590:0:8708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066c55 00010000:00080000:2.0:1783966760.852628:0:8708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c253f000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1783966760.853627:0:8708:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:3.0:1783966760.854701:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:2.0:1783966760.856710:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:3.0:1783966760.859429:0:8708:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783966760.859463:0:8708:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783966760.859700:0:8708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966760.859950:0:8708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966760.860384:0:8708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783966760.860476:0:8708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1783966760.862387:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1870624587803136:12345-0@lo:700: Request processed in 13201us (13282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.862407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783966760.862466:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf7480 x1870624587803136/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966760.862482:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1870624587803136:0@lo:700: 40000000:02000000:2.0:1783966760.862497:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:00080000:1.0:1783966760.868710:0:8709:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783966760.868721:0:8709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783966760.876365:0:8708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783966760.876382:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783966760.876433:0:8708:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783966760.876459:0:8708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066c5c 00000100:00080000:3.0:1783966760.876471:0:8708:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783966760.876478:0:8708:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a04c253f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966760.876516:0:8708:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c2682d80 x1870624587803392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783966760.876540:0:8708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783966760.877511:0:8708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966760.877517:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966760.877520:0:8708:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783966760.877523:0:8708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966760.877526:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966760.877528:0:8708:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783966760.877530:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783966760.877532:0:8708:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783966760.877648:0:8708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8708:1870624587803520:0@lo:502: 00000100:00100000:3.0:1783966760.877726:0:8708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.877787:0:8708:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f89540 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.879821:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803520 00000100:00100000:2.0:1783966760.879834:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803520 00000100:00100000:2.0:1783966760.879899:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783966760.879908:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:8708:x1870624587803520:12345-0@lo:502: 00000100:00100000:2.0:1783966760.880222:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:8708:x1870624587803520:12345-0@lo:502: Request processed in 314us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.880232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783966760.880283:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587803392:0@lo:8: 00000100:00100000:2.0:1783966760.880321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.880834:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803392 00000100:00100000:3.0:1783966760.880845:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803392 00000100:00100000:3.0:1783966760.880872:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783966760.880878:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587803392:12345-0@lo:8: 00010000:00080000:3.0:1783966760.880903:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1783966760.880940:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066c63 00002000:00100000:3.0:1783966760.881170:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a04c1ce4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783966760.881185:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1783966760.881188:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000001:00100000:3.0:1783966760.882164:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783966760.890069:0:8708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:8708:1870624587803520:0@lo:502: 00000020:01000000:0.0:1783966760.890140:0:8708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966760.890155:0:8708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966760.890157:0:8708:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783966760.890162:0:8708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1783966760.891718:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783966760.891767:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783966760.891796:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966760.891811:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966760.891824:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783966760.891827:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:0.0:1783966760.891830:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783966760.892066:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966760.892076:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966760.892087:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966760.892117:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803648:0@lo:101: 00000100:00100000:0.0:1783966760.893487:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966760.893535:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3110180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.893855:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587802752:12345-0@lo:700: Request processed in 44921us (47006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.893874:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:3.0:1783966760.894235:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783966760.894268:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a04c1ce3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966760.894328:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587803392:12345-0@lo:8: Request processed in 13448us (14006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.894337:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783966760.894363:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803648 00000100:00100000:3.0:1783966760.894370:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803648 00000100:00100000:3.0:1783966760.894407:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783966760.894416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587803648:12345-0@lo:101: 00010000:00010000:3.0:1783966760.894426:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966760.894444:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c6a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.894470:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c6a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.894495:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c6a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.894504:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0400, rc 0) 00000100:00100000:3.0:1783966760.894536:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587803648:12345-0@lo:101: Request processed in 121us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.894542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783966760.894619:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803648:0@lo:101: 00010000:00010000:3.0:1783966760.894635:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966760.894645:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966760.894718:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803776:0@lo:501: 00000100:00100000:3.0:1783966760.894747:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.894823:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.894834:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803776 00000100:00100000:3.0:1783966760.894838:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803776 00000100:00100000:3.0:1783966760.894859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783966760.894866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587803776:12345-0@lo:501: 00000100:00100000:3.0:1783966760.894933:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587803776:12345-0@lo:501: Request processed in 67us (184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783966760.894940:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1783966760.894959:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2682d80 x1870624587803392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783966770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966760.894981:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783966760.894988:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783966760.894995:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783966760.895000:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783966760.895003:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c253f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783966760.895020:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783966760.895025:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587803392:0@lo:8: 00000004:00080000:1.0:1783966760.895124:0:8709:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:0.0:1783966760.895342:0:8706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf7b80 x1870624587802752/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.895353:0:8706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587802752:0@lo:700: 00000004:00080000:1.0:1783966760.895680:0:8709:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237096909131ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783966760.895687:0:8709:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1783966760.895966:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587803776:0@lo:501: 10000000:01000000:2.0:1783966760.896007:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783966760.896016:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966760.896025:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783966760.898496:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783966760.899166:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587803904:0@lo:13: 00000100:00100000:2.0:1783966760.899253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783966760.899317:0:8710:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783966760.899344:0:8710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804032:0@lo:7: 00000100:00100000:2.0:1783966760.899373:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.899401:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804032 00000100:00100000:2.0:1783966760.899409:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804032 00000100:00100000:2.0:1783966760.899463:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783966760.899472:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8710:x1870624587804032:12345-0@lo:7: 00000100:00100000:0.0:1783966760.901734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587803904 00000100:00100000:0.0:1783966760.901755:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587803904 00000100:00100000:0.0:1783966760.901826:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783966760.901835:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587803904:12345-0@lo:13: 00002000:00000024:0.0:1783966760.901880:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923877888 avail 3692355584 00000100:00100000:0.0:1783966760.901963:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587803904:12345-0@lo:13: Request processed in 129us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966760.901971:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783966760.902261:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966760.902284:0:8710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b3c0 going to sleep for 11 seconds 00010000:00080000:0.0:1783966760.902342:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f1a25180 x1870624587803904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.902366:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587803904:0@lo:13: 00000004:00080000:0.0:1783966760.903757:0:8706:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783966760.903808:0:8706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804288:0@lo:7: 00000100:00100000:2.0:1783966760.903940:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587804160:0@lo:13: 00000100:00100000:2.0:1783966760.904001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966760.904059:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804160 00000100:00100000:2.0:1783966760.904065:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804160 00000100:00100000:2.0:1783966760.904104:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966760.904112:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587804160:12345-0@lo:13: 00002000:00000024:2.0:1783966760.904130:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923877888 avail 3692355584 00000100:00100000:2.0:1783966760.904172:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587804160:12345-0@lo:13: Request processed in 60us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.904191:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783966760.904229:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf1500 x1870624587804160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966760.904245:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587804160:0@lo:13: 00000100:00100000:0.0:1783966760.904651:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966760.904678:0:8706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3110d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.905766:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783966760.905793:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783966760.906486:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804288 00000100:00100000:0.0:1783966760.906495:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804288 00000100:00100000:2.0:1783966760.906807:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783966760.906818:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587804288:12345-0@lo:7: 00002000:00080000:3.0:1783966760.909075:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1783966760.909082:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783966760.909185:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8710:x1870624587804032:12345-0@lo:7: Request processed in 9701us (9798us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.909196:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783966760.909257:0:8710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f1a24380 x1870624587804032/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.909273:0:8710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804032:0@lo:7: 00000004:00080000:3.0:1783966760.909288:0:8710:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783966760.909330:0:8710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804416:0@lo:5: 00000100:00100000:3.0:1783966760.909362:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.909392:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804416 00000100:00100000:3.0:1783966760.909398:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804416 00000100:00100000:3.0:1783966760.909434:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783966760.909442:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8710:x1870624587804416:12345-0@lo:5: 00002000:00080000:3.0:1783966760.909468:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783966760.909472:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783966760.909505:0:8710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d163ba80 going to sleep for 11 seconds 00002000:00080000:2.0:1783966760.912630:0:8714:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1783966760.912640:0:8714:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1783966760.912745:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587804288:12345-0@lo:7: Request processed in 5924us (8089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.912756:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783966760.915237:0:8706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf2a00 x1870624587804288/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.915257:0:8706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804288:0@lo:7: 00000004:00080000:0.0:1783966760.915274:0:8706:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783966760.915323:0:8706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804544:0@lo:5: 00000100:00100000:0.0:1783966760.915386:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966760.915419:0:8706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3110d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.918910:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804544 00000100:00100000:2.0:1783966760.918924:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804544 00000100:00100000:2.0:1783966760.919038:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783966760.919049:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587804544:12345-0@lo:5: 00002000:00080000:2.0:1783966760.919086:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783966760.919187:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587804544:12345-0@lo:5: Request processed in 129us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966760.919195:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783966760.919316:0:8706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf2a00 x1870624587804544/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.919344:0:8706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804544:0@lo:5: 00000004:00080000:0.0:1783966760.919361:0:8706:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783966760.919407:0:8706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804672:0@lo:5: 00000100:00100000:0.0:1783966760.919443:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1783966760.923290:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1783966760.923332:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783966760.923481:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8710:x1870624587804416:12345-0@lo:5: Request processed in 14035us (14113us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783966760.923493:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783966760.923991:0:8706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3110d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966760.924169:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804672 00000100:00100000:3.0:1783966760.924188:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804672 00000100:00100000:3.0:1783966760.924230:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966760.924237:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8706:x1870624587804672:12345-0@lo:5: 00002000:00080000:3.0:1783966760.924300:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1783966760.928079:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8706:x1870624587804672:12345-0@lo:5: Request processed in 3835us (8629us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783966760.928094:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783966760.928235:0:8706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf2a00 x1870624587804672/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.928252:0:8706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8706:1870624587804672:0@lo:5: 00000004:00080000:3.0:1783966760.928269:0:8706:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1783966760.928318:0:8706:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8706:1870624587804800:0@lo:900: 00000100:00100000:3.0:1783966760.928361:0:8706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.928397:0:8706:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321a80 going to sleep for 11 seconds 00010000:00080000:3.0:1783966760.928423:0:8710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2680380 x1870624587804416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966760.928432:0:8710:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783966760.928437:0:8710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804416:0@lo:5: 00000004:00080000:3.0:1783966760.928447:0:8710:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783966760.928480:0:8710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804928:0@lo:700: 00000100:00100000:3.0:1783966760.928505:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966760.928541:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804928 00000100:00100000:3.0:1783966760.928547:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804928 00000100:00100000:1.0:1783966760.929703:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587804800 00000100:00100000:1.0:1783966760.929713:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587804800 00000100:00100000:1.0:1783966760.929758:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783966760.929782:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8706:x1870624587804800:12345-0@lo:900: 00000100:00100000:1.0:1783966760.929933:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8706:x1870624587804800:12345-0@lo:900: Request processed in 167us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966760.929942:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783966760.929984:0:8706:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2682300 x1870624587804800/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966760.929996:0:8706:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8706:1870624587804800:0@lo:900: 00000100:00100000:3.0:1783966760.931962:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783966760.931979:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8710:x1870624587804928:12345-0@lo:700: 00000100:00100000:3.0:1783966760.932118:0:8710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321180 going to sleep for 11 seconds 00000001:00080000:1.0:1783966760.944990:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1783966760.949692:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8710:x1870624587804928:12345-0@lo:700: Request processed in 17706us (21173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966760.949716:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783966760.949948:0:8710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2680380 x1870624587804928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966760.949963:0:8710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587804928:0@lo:700: 00000004:02000040:0.0:1783966760.953722:0:8710:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1783966760.959756:0:8710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587805056:0@lo:5: 00000100:00100000:0.0:1783966760.959928:0:8710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966760.959996:0:8710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966760.961680:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805056 00000100:00100000:2.0:1783966760.961694:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805056 00000100:00100000:2.0:1783966760.961756:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783966760.961766:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8710:x1870624587805056:12345-0@lo:5: 00002000:00080000:2.0:1783966760.969897:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783966760.969920:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1783966760.971345:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8710:x1870624587805056:12345-0@lo:5: Request processed in 9573us (11410us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783966760.971357:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783966760.972057:0:8710:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf3b80 x1870624587805056/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966776 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966760.972077:0:8710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8710:1870624587805056:0@lo:5: 00000004:00080000:0.0:1783966760.972093:0:8710:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1783966761.015400:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966761.335113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587805184:0@lo:41: 00000100:00100000:1.0:1783966761.335207:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966761.338409:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805184 00000100:00100000:1.0:1783966761.338424:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805184 00000100:00100000:1.0:1783966761.338500:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966761.338527:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587805184:12345-0@lo:41: 00000004:00000024:1.0:1783966761.338563:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783966761.338645:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587805184:12345-0@lo:41: Request processed in 120us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966761.338652:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966761.338710:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587805184:0@lo:41: 00010000:00010000:0.0:1783966762.039874:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783966762.996046:0:8808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783966763.062916:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783966763.957259:0:8860:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783966763.957500:0:8860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783966764.092238:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966764.407165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587805312:0@lo:41: 00000100:00100000:0.0:1783966764.407246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966764.407383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805312 00000100:00100000:3.0:1783966764.407392:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805312 00000100:00100000:3.0:1783966764.407451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783966764.407463:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587805312:12345-0@lo:41: 00000004:00000024:3.0:1783966764.407499:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783966764.407552:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587805312:12345-0@lo:41: Request processed in 91us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966764.407559:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783966764.407661:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587805312:0@lo:41: 00000001:00080000:3.0:1783966764.995097:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1783966765.111181:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966765.943171:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587805696:0@lo:13: 00000100:00100000:1.0:1783966765.943249:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966765.943304:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587805440:0@lo:13: 00000100:00100000:1.0:1783966765.943362:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587805568:0@lo:400: 00000100:00100000:2.0:1783966765.943389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966765.943534:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805696 00000100:00100000:0.0:1783966765.943546:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805696 00000100:00100000:0.0:1783966765.943606:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805440 00000100:00100000:0.0:1783966765.943609:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805440 00000100:00100000:0.0:1783966765.943631:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966765.943642:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587805696:12345-0@lo:13: 00002000:00000024:0.0:1783966765.943684:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966765.943840:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587805696:12345-0@lo:13: Request processed in 198us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.943862:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966765.943883:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783966765.943889:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587805440:12345-0@lo:13: 00002000:00000024:0.0:1783966765.943900:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966765.946041:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587805440:12345-0@lo:13: Request processed in 2137us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.946059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1783966765.946129:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966765.946159:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587806208:0@lo:400: 00000100:00100000:0.0:1783966765.946242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966765.946258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587805824:0@lo:400: 00010000:00080000:0.0:1783966765.946314:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf5180 x1870624587805696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966765.946328:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783966765.946356:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587805696:0@lo:13: 00000100:00100000:0.0:1783966765.946406:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806208 00000100:00100000:0.0:1783966765.946414:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806208 00000100:00100000:0.0:1783966765.946463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783966765.946472:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587806208:12345-0@lo:400: 00010000:00080000:2.0:1783966765.946551:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf0380 x1870624587805440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966765.946561:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1783966765.946578:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587805440:0@lo:13: 00000100:00100000:2.0:1783966765.946595:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587805952:0@lo:400: 00000100:00100000:0.0:1783966765.947156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587806208:12345-0@lo:400: Request processed in 683us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.947165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783966765.947214:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587806208:0@lo:400: 00000100:00100000:3.0:1783966765.947273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966765.947343:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805824 00000100:00100000:0.0:1783966765.947349:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805824 00000100:00100000:0.0:1783966765.947390:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783966765.947415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587805824:12345-0@lo:400: 00000100:00100000:1.0:1783966765.947855:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966765.947925:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587806080:0@lo:400: 00000100:00100000:1.0:1783966765.948303:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966765.948368:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587805824:12345-0@lo:400: Request processed in 950us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966765.948374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805568 00000100:00100000:0.0:1783966765.948382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783966765.948384:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805568 00000100:00100000:0.0:1783966765.948410:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806080 00000100:00100000:0.0:1783966765.948418:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806080 00000100:00100000:0.0:1783966765.948452:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783966765.948460:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587806080:12345-0@lo:400: 00000100:00100000:1.0:1783966765.948491:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966765.948505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:3648:x1870624587805568:12345-0@lo:400: 00010000:00080000:3.0:1783966765.948534:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2681880 x1870624587805824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966765.948537:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587806080:12345-0@lo:400: Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.948563:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783966765.948572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587805824:0@lo:400: 00000100:00100000:3.0:1783966765.948737:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587806336:0@lo:400: 00010000:00080000:0.0:1783966765.948739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2682300 x1870624587806080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966765.948756:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587806080:0@lo:400: 00000100:00100000:0.0:1783966765.948800:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587805568:0@lo:400: 00000100:00100000:1.0:1783966765.948811:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:3648:x1870624587805568:12345-0@lo:400: Request processed in 71us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966765.948826:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783966765.948879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966765.948907:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806336 00000100:00100000:0.0:1783966765.948913:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806336 00000100:00100000:0.0:1783966765.948986:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783966765.948993:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587806336:12345-0@lo:400: 00000100:00100000:0.0:1783966765.949042:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587806336:12345-0@lo:400: Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.949048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783966765.949144:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783966765.949211:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2682d80 x1870624587806336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966765.949227:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587806336:0@lo:400: 00000100:00100000:2.0:1783966765.949233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966765.949334:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587806464:0@lo:400: 00000100:00100000:2.0:1783966765.949368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966765.949467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806464 00000100:00100000:3.0:1783966765.949472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806464 00000100:00100000:3.0:1783966765.949519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783966765.949527:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587806464:12345-0@lo:400: 00000100:00100000:3.0:1783966765.949578:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587806464:12345-0@lo:400: Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966765.949587:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1783966765.949664:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2683480 x1870624587806464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966765.949674:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587806464:0@lo:400: 00000100:00080000:1.0:1783966765.949733:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966765.949765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587805952 00000100:00100000:0.0:1783966765.949797:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587805952 00000100:00100000:0.0:1783966765.949874:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783966765.949882:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587805952:12345-0@lo:400: 00000100:00100000:0.0:1783966765.949942:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587805952:12345-0@lo:400: Request processed in 61us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966765.949949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783966765.950003:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587805952:0@lo:400: 00010000:00010000:0.0:1783966766.140732:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966766.455230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587806592:0@lo:41: 00000100:00100000:1.0:1783966766.455308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966766.455438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806592 00000100:00100000:2.0:1783966766.455447:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806592 00000100:00100000:2.0:1783966766.455494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783966766.455502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587806592:12345-0@lo:41: 00000004:00000024:2.0:1783966766.455535:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1783966766.458997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587806592:12345-0@lo:41: Request processed in 3484us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966766.459011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783966766.459270:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587806592:0@lo:41: 00000020:00000004:3.0:1783966767.120267:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783966767.121312:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783966767.158871:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966768.185934:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783966768.205368:0:9010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966768.205377:0:9010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1783966769.208427:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966769.530209:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587806720:0@lo:41: 00000100:00100000:2.0:1783966769.530348:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966769.530471:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806720 00000100:00100000:3.0:1783966769.530481:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806720 00000100:00100000:3.0:1783966769.530539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966769.530549:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587806720:12345-0@lo:41: 00000004:00000024:3.0:1783966769.530584:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1783966769.532723:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587806720:12345-0@lo:41: Request processed in 2169us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966769.532735:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783966769.533242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587806720:0@lo:41: 00010000:00010000:0.0:1783966770.243584:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966771.063174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587806848:0@lo:13: 00000100:00100000:1.0:1783966771.063305:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587807104:0@lo:400: 00000100:00100000:3.0:1783966771.063307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966771.063369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966771.063378:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587807360:0@lo:400: 00000100:00100000:1.0:1783966771.063396:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587807616:0@lo:400: 00000100:00100000:2.0:1783966771.063438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587806976:0@lo:400: 00000100:00100000:1.0:1783966771.064668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966771.064840:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807104 00000100:00100000:1.0:1783966771.064849:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807104 00000100:00100000:2.0:1783966771.064882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966771.064899:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807616 00000100:00100000:1.0:1783966771.064904:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807616 00000100:00100000:2.0:1783966771.064923:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587807488:0@lo:400: 00000100:00100000:1.0:1783966771.064945:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783966771.064955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587807104:12345-0@lo:400: 00000100:00100000:2.0:1783966771.064961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966771.065003:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587808000:0@lo:400: 00000100:00100000:2.0:1783966771.065029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966771.065061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807488 00000100:00100000:1.0:1783966771.065089:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587807104:12345-0@lo:400: Request processed in 135us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966771.065098:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783966771.065116:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966771.065124:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587807616:12345-0@lo:400: 00000100:00100000:1.0:1783966771.065157:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587807616:12345-0@lo:400: Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966771.065164:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783966771.065219:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807488 00000100:00080000:1.0:1783966771.065220:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966771.065278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783966771.065284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587807488:12345-0@lo:400: 00000100:00100000:1.0:1783966771.065357:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587807232:0@lo:400: 00000100:00100000:2.0:1783966771.065453:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587807488:12345-0@lo:400: Request processed in 168us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966771.065460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783966771.065465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966771.065477:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807232 00000100:00100000:2.0:1783966771.065482:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807232 00000100:00100000:1.0:1783966771.065488:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587807744:0@lo:400: 00000100:00100000:1.0:1783966771.065519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966771.065572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783966771.065645:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587807232:12345-0@lo:400: 00000100:00100000:1.0:1783966771.066118:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807744 00000100:00100000:1.0:1783966771.066123:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807744 00000100:00100000:1.0:1783966771.066174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783966771.066181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587807744:12345-0@lo:400: 00000100:00100000:2.0:1783966771.066219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587807232:12345-0@lo:400: Request processed in 574us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966771.066225:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587807744:12345-0@lo:400: Request processed in 43us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966771.066232:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783966771.066234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783966771.066258:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808000 00000100:00100000:2.0:1783966771.066263:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808000 00000100:00100000:2.0:1783966771.066293:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783966771.066299:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587808000:12345-0@lo:400: 00000100:00100000:3.0:1783966771.066363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966771.066375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807360 00000100:00100000:1.0:1783966771.066380:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807360 00000100:00100000:1.0:1783966771.066400:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783966771.066406:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587807360:12345-0@lo:400: 00000100:00100000:1.0:1783966771.066440:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587807360:12345-0@lo:400: Request processed in 34us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966771.066447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966771.066459:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587808000:12345-0@lo:400: Request processed in 157us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966771.066469:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783966771.066476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587808128:0@lo:13: 00000100:00100000:3.0:1783966771.066487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587807872:0@lo:400: 00000100:00100000:1.0:1783966771.066512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966771.066524:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966771.066558:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf6a00 x1870624587807104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966771.066571:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587807872 00000100:00100000:1.0:1783966771.066574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587807104:0@lo:400: 00000100:00100000:2.0:1783966771.066646:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587807872 00010000:00080000:3.0:1783966771.066654:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf7800 x1870624587807360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783966771.066654:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf4a80 x1870624587807616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966771.066676:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587807616:0@lo:400: 00000100:00100000:2.0:1783966771.066681:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783966771.066690:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587807872:12345-0@lo:400: 00000100:00100000:3.0:1783966771.066727:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587807360:0@lo:400: 00000100:00100000:1.0:1783966771.066727:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806848 00000100:00100000:2.0:1783966771.066733:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587807872:12345-0@lo:400: Request processed in 42us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966771.066742:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783966771.066747:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf6680 x1870624587807872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966771.066786:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587807872:0@lo:400: 00000100:00100000:2.0:1783966771.066798:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587807232:0@lo:400: 00000100:00100000:1.0:1783966771.066814:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806848 00000100:00100000:3.0:1783966771.066822:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808128 00000100:00100000:3.0:1783966771.066827:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808128 00010000:00080000:2.0:1783966771.066832:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf5880 x1870624587807744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966771.066845:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587807744:0@lo:400: 00000100:00100000:1.0:1783966771.066846:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783966771.066859:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587806848:12345-0@lo:13: 00002000:00000024:1.0:1783966771.066881:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966771.066933:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587806848:12345-0@lo:13: Request processed in 77us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966771.066934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587806976 00000100:00100000:3.0:1783966771.066939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587806976 00000100:00100000:1.0:1783966771.066949:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783966771.066962:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587807488:0@lo:400: 00000100:00100000:1.0:1783966771.066971:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966771.066979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1783966771.066993:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c1cf4000 x1870624587808000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966771.066994:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587808128:12345-0@lo:13: 00000100:00100000:3.0:1783966771.067005:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:3647:x1870624587806976:12345-0@lo:400: 00002000:00000024:1.0:1783966771.067013:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966771.067016:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587808000:0@lo:400: 00000100:00100000:3.0:1783966771.067204:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:3647:x1870624587806976:12345-0@lo:400: Request processed in 203us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966771.067206:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587808128:12345-0@lo:13: Request processed in 225us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966771.067218:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783966771.067222:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783966771.067325:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587806976:0@lo:400: 00010000:00080000:3.0:1783966771.067346:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef208380 x1870624587806848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966771.067360:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587806848:0@lo:13: 00010000:00080000:1.0:1783966771.067571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f1abad80 x1870624587808128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966771.067586:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587808128:0@lo:13: 00000100:00080000:0.0:1783966771.071316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966771.071327:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783966771.259316:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966771.575394:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966771.575421:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587808256:0@lo:41: 00000100:00100000:2.0:1783966771.575494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966771.575554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808256 00000100:00100000:2.0:1783966771.575562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808256 00000100:00100000:2.0:1783966771.575608:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783966771.575616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587808256:12345-0@lo:41: 00000004:00000024:2.0:1783966771.575663:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1783966771.575710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587808256:12345-0@lo:41: Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966771.575717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783966771.575764:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587808256:0@lo:41: 00010000:00010000:1.0:1783966772.279919:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966773.311098:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966774.332703:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966774.651353:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966774.651382:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587808384:0@lo:41: 00000100:00100000:1.0:1783966774.651452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966774.651541:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808384 00000100:00100000:1.0:1783966774.651549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808384 00000100:00100000:1.0:1783966774.651611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783966774.651621:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587808384:12345-0@lo:41: 00000004:00000024:1.0:1783966774.651656:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1783966774.651711:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587808384:12345-0@lo:41: Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966774.651717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783966774.651836:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587808384:0@lo:41: 00010000:00010000:2.0:1783966775.351228:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966776.183229:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587808896:0@lo:400: 00000100:00100000:2.0:1783966776.183308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966776.183358:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587809408:0@lo:400: 00000100:00100000:2.0:1783966776.183404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966776.183430:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783966776.183436:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587808768:0@lo:400: 00000100:00100000:2.0:1783966776.183455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966776.183470:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587809280:0@lo:400: 00000100:00100000:2.0:1783966776.183501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966776.183630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808896 00000100:00100000:1.0:1783966776.183638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808896 00000100:00100000:1.0:1783966776.183695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783966776.183704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587808896:12345-0@lo:400: 00000100:00100000:1.0:1783966776.183763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587808896:12345-0@lo:400: Request processed in 59us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966776.183793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783966776.183817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809408 00000100:00100000:1.0:1783966776.183820:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809408 00000100:00100000:1.0:1783966776.183852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808768 00000100:00100000:1.0:1783966776.183855:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808768 00000100:00100000:1.0:1783966776.183953:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809280 00000100:00100000:1.0:1783966776.183956:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809280 00000100:00100000:1.0:1783966776.183972:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783966776.183978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587809408:12345-0@lo:400: 00000100:00100000:1.0:1783966776.184008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587809408:12345-0@lo:400: Request processed in 30us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966776.184014:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783966776.184025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783966776.184029:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587808768:12345-0@lo:400: 00000100:00100000:1.0:1783966776.184054:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587808768:12345-0@lo:400: Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966776.184061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783966776.184072:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783966776.184078:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587809280:12345-0@lo:400: 00000100:00100000:1.0:1783966776.184117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587809280:12345-0@lo:400: Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966776.184123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783966776.184257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587808640:0@lo:400: 00000100:00100000:0.0:1783966776.184292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966776.184318:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587809152:0@lo:400: 00000100:00100000:0.0:1783966776.184340:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966776.184557:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587808512:0@lo:13: 00000100:00100000:3.0:1783966776.184591:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966776.184608:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587809024:0@lo:400: 00000100:00100000:3.0:1783966776.184859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966776.188614:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587809664:0@lo:400: 00000100:00100000:0.0:1783966776.188699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966776.189085:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808640 00000100:00100000:0.0:1783966776.189093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808640 00000100:00100000:0.0:1783966776.189145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783966776.189155:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:3648:x1870624587808640:12345-0@lo:400: 00000100:00100000:0.0:1783966776.189210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:3648:x1870624587808640:12345-0@lo:400: Request processed in 56us (4916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966776.189217:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783966776.189279:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587808640:0@lo:400: 00000100:00100000:3.0:1783966776.190659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587809536:0@lo:400: 00000100:00100000:3.0:1783966776.190704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966776.190756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809024 00000100:00100000:3.0:1783966776.190786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809024 00000100:00100000:3.0:1783966776.190826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966776.190834:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587809024:12345-0@lo:400: 00000100:00100000:3.0:1783966776.190913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587809024:12345-0@lo:400: Request processed in 79us (6053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966776.190921:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966776.190967:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587808512 00000100:00100000:3.0:1783966776.190972:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587808512 00000100:00100000:3.0:1783966776.191002:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966776.191008:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587808512:12345-0@lo:13: 00002000:00000024:3.0:1783966776.191031:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966776.191062:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587808512:12345-0@lo:13: Request processed in 54us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966776.191068:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783966776.191116:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f4cad500 x1870624587808512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966776.191134:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587808512:0@lo:13: 00010000:00080000:3.0:1783966776.191143:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef20b800 x1870624587809024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966776.191152:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587809024:0@lo:400: 00000100:00100000:0.0:1783966776.191452:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809664 00000100:00100000:0.0:1783966776.191457:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809664 00000100:00100000:0.0:1783966776.191487:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809536 00000100:00100000:0.0:1783966776.191496:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809536 00000100:00100000:0.0:1783966776.191520:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966776.191525:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587809664:12345-0@lo:400: 00000100:00100000:0.0:1783966776.191565:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587809664:12345-0@lo:400: Request processed in 39us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966776.191571:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783966776.191583:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783966776.191589:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587809536:12345-0@lo:400: 00000100:00100000:0.0:1783966776.191621:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587809536:12345-0@lo:400: Request processed in 32us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966776.191626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783966776.191678:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef209f80 x1870624587809664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966776.191689:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587809664:0@lo:400: 00010000:00080000:0.0:1783966776.191712:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef208e00 x1870624587809536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966776.191720:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587809536:0@lo:400: 00000100:00100000:2.0:1783966776.193956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809152 00000100:00100000:2.0:1783966776.193969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809152 00000100:00100000:0.0:1783966776.194067:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587809792:0@lo:13: 00000100:00100000:0.0:1783966776.194125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966776.194371:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966776.194380:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587809152:12345-0@lo:400: 00000100:00100000:2.0:1783966776.194439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587809152:12345-0@lo:400: Request processed in 60us (10097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966776.194446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966776.194483:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587809152:0@lo:400: 00000100:00080000:1.0:1783966776.196019:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966776.196026:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966776.196038:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966776.196076:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809792 00000100:00100000:1.0:1783966776.196083:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809792 00000100:00100000:1.0:1783966776.196114:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783966776.196121:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587809792:12345-0@lo:13: 00002000:00000024:1.0:1783966776.196142:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966776.205807:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587809792:12345-0@lo:13: Request processed in 9675us (11671us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966776.205823:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783966776.206138:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef209880 x1870624587808768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966776.206155:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587808768:0@lo:400: 00010000:00080000:3.0:1783966776.206170:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef209500 x1870624587809280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966776.206180:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587809280:0@lo:400: 00000100:00100000:3.0:1783966776.206192:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587808896:0@lo:400: 00010000:00080000:3.0:1783966776.206217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef20aa00 x1870624587809408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966776.206226:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587809408:0@lo:400: 00010000:00080000:0.0:1783966776.215447:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7d59880 x1870624587809792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966776.215479:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587809792:0@lo:13: 00010000:00010000:1.0:1783966776.377304:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966776.702144:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966776.702169:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587809920:0@lo:41: 00000100:00100000:0.0:1783966776.702232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966776.703300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587809920 00000100:00100000:0.0:1783966776.703310:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587809920 00000100:00100000:0.0:1783966776.703408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783966776.703418:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587809920:12345-0@lo:41: 00000004:00000024:0.0:1783966776.703556:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1783966776.703632:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587809920:12345-0@lo:41: Request processed in 215us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966776.703639:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783966776.703712:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587809920:0@lo:41: 00010000:00010000:1.0:1783966777.402370:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783966777.627669:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783966777.627672:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783966777.627674:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783966777.627855:0:9509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05ef299800 00000020:01000004:2.0:1783966777.635069:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783966777.635089:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783966777.635106:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a05f55f4d40) 00000020:00000080:2.0:1783966777.635124:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783966777.697761:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1783966777.697849:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1783966777.735637:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783966777.736008:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783966777.736022:0:9509:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783966777.736033:0:9509:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b316066c7f 00000020:01000004:2.0:1783966777.736040:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783966777.736065:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783966777.736068:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783966777.736320:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783966777.736354:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1783966777.736358:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783966777.753061:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783966777.753103:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1783966777.753108:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783966777.753109:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.753111:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.753112:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966777.753113:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.753114:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.753116:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.753117:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966777.753119:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966777.753120:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.753122:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783966777.753125:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1783966777.753128:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783966777.753129:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.753130:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.753131:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966777.753133:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.753134:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.753135:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.753136:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966777.753137:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966777.753138:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.753139:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783966777.753165:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783966777.753183:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587810048:0@lo:253: 00000100:00100000:3.0:1783966777.753334:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.753456:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966777.753598:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810048 00000100:00100000:1.0:1783966777.753607:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810048 00000100:00100000:1.0:1783966777.753702:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783966777.753711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:9509:x1870624587810048:12345-0@lo:253: 20000000:01000000:1.0:1783966777.753741:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783966777.753745:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783966777.753749:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783966777.753753:0:6510:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783966777.754044:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966777.754164:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1783966777.754179:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783966777.754196:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1783966777.754202:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783966777.754214:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1783966777.754229:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1783966777.754325:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1783966777.754341:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:1.0:1783966777.754343:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:1.0:1783966777.754364:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1783966777.754373:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783966777.754397:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1783966777.754404:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:1.0:1783966777.754416:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1783966777.754422:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783966777.754436:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1783966777.754452:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1783966777.754607:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1783966777.754622:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:1.0:1783966777.754624:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:1.0:1783966777.754640:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1783966777.754645:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783966777.754656:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1783966777.754660:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:1.0:1783966777.754670:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1783966777.755333:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783966777.755370:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1783966777.755394:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1783966777.755792:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1783966777.755807:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.159@tcp 20000000:01000000:1.0:1783966777.755809:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.159@tcp (null) (null) (null) 00000040:00080000:1.0:1783966777.755823:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1783966777.755828:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783966777.755840:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1783966777.755846:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.159@tcp (null) (null) 00000040:00080000:1.0:1783966777.755875:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1783966777.755883:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783966777.755898:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1783966777.755913:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1783966777.755925:0:6510:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783966777.755928:0:6510:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783966777.755941:0:6510:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783966777.755984:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783966777.755987:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783966777.758732:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1783966777.758801:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1783966777.758821:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1783966777.760942:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1783966777.760991:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1783966777.761008:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1783966777.761021:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783966777.761023:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783966777.762885:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1783966777.762940:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1783966777.762952:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783966777.763148:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783966777.763170:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1783966777.763186:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1783966777.763196:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783966777.763199:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783966777.763512:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1783966777.763546:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1783966777.763562:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1783966777.763750:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1783966777.763810:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1783966777.763830:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1783966777.763839:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1783966777.763841:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783966777.764187:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1783966777.764204:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1783966777.764219:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1783966777.764389:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1783966777.764408:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1783966777.764422:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1783966777.764430:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783966777.764432:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783966777.768610:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1783966777.771385:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1783966777.771422:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1783966777.771440:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1783966777.771455:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783966777.771475:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771494:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b75 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771503:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b9f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771635:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bde expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771642:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771649:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c24 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771656:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c40 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771663:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c6a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771671:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.771845:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772034:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 21 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772050:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810176:0@lo:104: 00000100:00100000:1.0:1783966777.772463:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.772519:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772529:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 21 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772549:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810304:0@lo:104: 00000100:00100000:1.0:1783966777.772574:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.772610:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772618:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.772624:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810176 00000100:00100000:1.0:1783966777.772626:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810432:0@lo:104: 00000100:00100000:3.0:1783966777.772631:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810176 00000100:00100000:1.0:1783966777.772645:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.772659:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.772666:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810304 00010000:00010000:1.0:1783966777.772667:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.772668:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810304 00000100:00100000:3.0:1783966777.772677:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810432 00000100:00100000:3.0:1783966777.772679:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810432 00000100:00100000:3.0:1783966777.772693:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966777.772702:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:6510:x1870624587810176:12345-0@lo:104: 00010000:00010000:3.0:1783966777.772716:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772757:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810560:0@lo:104: 00000100:00100000:1.0:1783966777.772812:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.772830:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772839:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 21 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772846:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810688:0@lo:104: 00000100:00100000:1.0:1783966777.772879:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.772895:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772915:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772924:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810816:0@lo:104: 00000100:00100000:0.0:1783966777.772951:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1783966777.772952:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.772960:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1783966777.772974:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.772981:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.772988:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810944:0@lo:104: 00000100:00100000:1.0:1783966777.773007:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a840 going to sleep for 11 seconds 00010000:00010000:3.0:1783966777.773214:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966777.773221:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:6510:x1870624587810176:12345-0@lo:104: Request processed in 520us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.773229:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966777.773252:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783966777.773269:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.773277:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810560 00000100:00100000:3.0:1783966777.773280:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810560 00000100:00100000:3.0:1783966777.773294:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810688 00000100:00100000:3.0:1783966777.773297:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810688 00000100:00100000:3.0:1783966777.773306:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810816 00000100:00100000:3.0:1783966777.773308:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810816 00000100:00100000:3.0:1783966777.773315:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587810944 00000100:00100000:3.0:1783966777.773317:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587810944 00000100:00100000:3.0:1783966777.773328:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783966777.773333:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+8:6510:x1870624587810304:12345-0@lo:104: 00010000:00010000:3.0:1783966777.773341:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.773375:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783966777.773387:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+8:6510:x1870624587810304:12345-0@lo:104: Request processed in 53us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.773393:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783966777.773405:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783966777.773411:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+7:6510:x1870624587810432:12345-0@lo:104: 00010000:00010000:3.0:1783966777.773418:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.773445:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783966777.773449:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+7:6510:x1870624587810432:12345-0@lo:104: Request processed in 40us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.773454:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783966777.773464:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783966777.773470:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+6:6510:x1870624587810560:12345-0@lo:104: 00010000:00010000:3.0:1783966777.773477:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.773503:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783966777.773507:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+6:6510:x1870624587810560:12345-0@lo:104: Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.773512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783966777.773628:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810176:0@lo:104: 00000100:00100000:2.0:1783966777.773638:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810304:0@lo:104: 00000100:00100000:2.0:1783966777.773644:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810432:0@lo:104: 00000100:00100000:2.0:1783966777.773649:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810560:0@lo:104: 00000100:00100000:3.0:1783966777.773686:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783966777.773694:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:6510:x1870624587810688:12345-0@lo:104: 00010000:00010000:3.0:1783966777.773702:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773792:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783966777.773799:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773807:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783966777.773811:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773820:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.773827:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:0.0:1783966777.773828:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966777.773834:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783966777.773871:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773878:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783966777.773913:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773920:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773935:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783966777.773938:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773945:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783966777.773948:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773955:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783966777.773961:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966777.773967:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783966777.773981:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.773984:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811072:0@lo:103: 00010000:00010000:0.0:1783966777.773987:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783966777.773992:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.773999:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b316066c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.774010:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783966777.774018:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.774024:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0c00 already unused, calling callback (ffffffffc150bc20) 00000100:00100000:1.0:1783966777.774026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1783966777.774027:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.774033:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783966777.774039:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966777.774044:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783966777.774057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1783966777.774058:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.774062:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811200:0@lo:103: 00010000:00010000:0.0:1783966777.774063:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783966777.774077:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.774094:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316066bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c01 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.774105:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966777.774106:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966777.774108:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966777.774122:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811328:0@lo:103: 00000100:00100000:2.0:1783966777.775240:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810688:0@lo:104: 00010000:00010000:2.0:1783966777.775406:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.775413:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.775421:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966777.775425:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.775433:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966777.775472:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966777.775478:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966777.775555:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.775561:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966777.775569:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.775575:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316066c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c47 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.775586:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.775587:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.775588:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.775597:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.775599:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966777.775840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.775900:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811072 00000100:00100000:1.0:1783966777.775907:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811072 00010000:00010000:1.0:1783966777.775932:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 22 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.775958:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811200 00000100:00100000:1.0:1783966777.775961:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811200 00010000:00010000:1.0:1783966777.775972:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.776000:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783966777.776007:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+23:3647:x1870624587811072:12345-0@lo:103: 00010000:00010000:1.0:1783966777.776019:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.776024:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 23 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.776035:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 23 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.776050:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0400/0x9269c8b316066c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066c6a expref: 23 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.776063:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966777.776479:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966777.776492:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:6510:x1870624587810688:12345-0@lo:104: Request processed in 2799us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.776501:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783966777.776534:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783966777.776542:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5459450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:6510:x1870624587810816:12345-0@lo:104: 00010000:00010000:3.0:1783966777.776553:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776588:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966777.776594:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776601:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966777.776605:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776612:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966777.776630:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966777.776636:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966777.776662:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776668:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966777.776683:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776690:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066be5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.776701:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.776703:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.776705:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966777.776723:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811584:0@lo:103: 00000100:00100000:0.0:1783966777.776911:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.776939:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966777.776946:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811456:0@lo:103: 00000100:00100000:0.0:1783966777.776984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.777113:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+22:3647:x1870624587811072:12345-0@lo:103: Request processed in 1105us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.777121:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783966777.777137:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811328 00000100:00100000:1.0:1783966777.777141:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811328 00010000:00010000:1.0:1783966777.777156:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 22 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.777169:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811456 00000100:00100000:1.0:1783966777.777171:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811456 00010000:00010000:1.0:1783966777.777180:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 23 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.777192:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783966777.777199:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+23:3647:x1870624587811200:12345-0@lo:103: 00010000:00010000:1.0:1783966777.777216:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.777222:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777230:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777243:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1800/0x9269c8b316066c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066c24 expref: 23 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777254:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.777279:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+22:3647:x1870624587811200:12345-0@lo:103: Request processed in 81us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.777286:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783966777.777299:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783966777.777305:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+21:3645:x1870624587811328:12345-0@lo:103: 00010000:00010000:1.0:1783966777.777312:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.777317:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777325:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777335:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316066c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066bfa expref: 21 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777344:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.777381:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+20:3645:x1870624587811328:12345-0@lo:103: Request processed in 77us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.777387:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783966777.777408:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783966777.777415:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+19:3645:x1870624587811456:12345-0@lo:103: 00010000:00010000:1.0:1783966777.777424:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.777429:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 19 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777438:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 19 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777449:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066c40 expref: 19 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777458:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.777482:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3645:x1870624587811456:12345-0@lo:103: Request processed in 69us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.777489:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783966777.777715:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783966777.777723:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:6510:x1870624587810944:12345-0@lo:104: 00010000:00010000:1.0:1783966777.777733:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.777816:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810944:0@lo:104: 00010000:00010000:1.0:1783966777.777836:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783966777.777842:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:6510:x1870624587810944:12345-0@lo:104: Request processed in 121us (4573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.777848:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783966777.777874:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966777.777879:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777898:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966777.777902:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777909:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966777.777915:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966777.777920:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966777.777944:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777950:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966777.777961:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777967:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b7c expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.777977:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.777979:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.777981:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966777.778108:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587811712:0@lo:103: 00000100:00100000:0.0:1783966777.778140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.778184:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811456:0@lo:103: 00000100:00100000:0.0:1783966777.778193:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811328:0@lo:103: 00000100:00100000:1.0:1783966777.778292:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811712 00000100:00100000:1.0:1783966777.778297:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811712 00010000:00010000:1.0:1783966777.778314:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.778343:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783966777.778357:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3648:x1870624587811712:12345-0@lo:103: 00010000:00010000:1.0:1783966777.778365:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.778371:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.778380:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.778391:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066b7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b75 expref: 18 pid: 6511 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.778402:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.778431:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+17:3648:x1870624587811712:12345-0@lo:103: Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.778438:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783966777.778503:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587811712:0@lo:103: 00000100:00100000:2.0:1783966777.779379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966777.779405:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966777.779413:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5459450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:6510:x1870624587810816:12345-0@lo:104: Request processed in 2873us (6459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.779422:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783966777.779457:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1870624587810816:0@lo:104: 00010000:00010000:1.0:1783966777.779489:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.779619:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811200:0@lo:103: 00000100:00100000:2.0:1783966777.779628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811072:0@lo:103: 00010000:00010000:2.0:1783966777.779653:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966777.779659:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.779667:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966777.779670:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.779690:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966777.779698:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966777.779703:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966777.779737:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.779743:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966777.779788:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.779796:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b316066b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ba6 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.779810:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.779812:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.779814:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966777.779867:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811840:0@lo:103: 00000100:00100000:3.0:1783966777.779905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.779952:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811584 00000100:00100000:1.0:1783966777.779958:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811584 00010000:00010000:1.0:1783966777.779982:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 17 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.780012:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811840 00000100:00100000:1.0:1783966777.780015:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811840 00010000:00010000:1.0:1783966777.780026:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 18 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.780041:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783966777.780055:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3647:x1870624587811584:12345-0@lo:103: 00010000:00010000:1.0:1783966777.780066:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.780073:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780140:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780156:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066bde expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780169:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.780213:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+17:3647:x1870624587811584:12345-0@lo:103: Request processed in 158us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.780220:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783966777.780233:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783966777.780239:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+16:3645:x1870624587811840:12345-0@lo:103: 00010000:00010000:1.0:1783966777.780247:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.780251:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 16 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780259:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 16 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780267:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b9f expref: 16 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780279:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780297:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780311:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780317:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780325:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780331:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780336:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966777.780340:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780346:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780360:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780370:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.780482:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+15:3645:x1870624587811840:12345-0@lo:103: Request processed in 242us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.780489:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783966777.780510:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780594:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.780600:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066c86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783966777.780613:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783966777.781480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587811584:0@lo:103: 00000100:00100000:2.0:1783966777.781829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587811840:0@lo:103: 00000100:00100000:2.0:1783966777.783074:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+14:9509:x1870624587810048:12345-0@lo:253: Request processed in 29358us (29735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.783099:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783966777.783323:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587810048:0@lo:253: 10000000:01000000:3.0:1783966777.783338:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783966777.783341:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783966777.783343:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.783344:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.783345:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1783966777.783346:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.783348:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.783349:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.783351:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783966777.783352:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.783353:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783966777.783374:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05ef299800 from lustre-OST0001 10000000:01000000:3.0:1783966777.783405:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783966777.783408:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783966777.783427:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 10000000:01000000:3.0:1783966777.783431:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783966777.783466:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.783477:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.783488:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.783506:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587811968:0@lo:101: 00000100:00100000:3.0:1783966777.783617:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.783708:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d9300600 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.783744:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587811968 00000100:00100000:0.0:1783966777.783751:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587811968 00000100:00100000:0.0:1783966777.783981:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783966777.783992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:9509:x1870624587811968:12345-0@lo:101: 00010000:00010000:0.0:1783966777.784005:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966777.784018:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0030800/0x9269c8b316066c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c8d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.784039:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0030800/0x9269c8b316066c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c8d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.784048:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0030800/0x9269c8b316066c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c8d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.784057:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030800, rc 0) 00000100:00100000:0.0:1783966777.784292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587811968:12345-0@lo:101: Request processed in 302us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.784299:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783966777.784412:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587811968:0@lo:101: 00010000:00010000:3.0:1783966777.784425:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.784434:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.784590:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812096:0@lo:501: 00000100:00100000:3.0:1783966777.784618:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.784660:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d9300600 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.784703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812096 00000100:00100000:2.0:1783966777.784708:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812096 00000100:00100000:2.0:1783966777.784822:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783966777.784830:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812096:12345-0@lo:501: 00000100:00100000:2.0:1783966777.784920:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812096:12345-0@lo:501: Request processed in 91us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783966777.784927:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783966777.784999:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812096:0@lo:501: 10000000:01000000:3.0:1783966777.785013:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783966777.785030:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783966777.785036:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.785050:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.785058:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.785079:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783966777.785119:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05ef299800 10000000:01000000:3.0:1783966777.785125:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783966777.785138:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783966777.785141:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783966777.785145:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783966777.785148:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783966777.785166:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.785174:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.785183:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.785195:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812224:0@lo:101: 00000100:00100000:3.0:1783966777.785224:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966777.785287:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966777.785294:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785302:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966777.785306:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785315:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966777.785322:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966777.785328:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783966777.785348:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785355:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966777.785374:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785382:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9269c8b316066c94 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785401:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.785403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.785405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966777.785414:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966777.785425:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587812352:0@lo:103: 00000100:00100000:1.0:1783966777.785457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.785490:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812352 00000100:00100000:1.0:1783966777.785494:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812352 00000100:00100000:1.0:1783966777.785540:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783966777.785548:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+15:3645:x1870624587812352:12345-0@lo:103: 00010000:00010000:1.0:1783966777.785557:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.785571:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030800/0x9269c8b316066c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066c8d expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.785584:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.785613:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+14:3645:x1870624587812352:12345-0@lo:103: Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.785619:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783966777.785648:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587812352:0@lo:103: 00000100:00100000:3.0:1783966777.786016:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.786145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812224 00000100:00100000:0.0:1783966777.786152:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812224 00000100:00100000:0.0:1783966777.786175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783966777.786190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+14:9509:x1870624587812224:12345-0@lo:101: 00010000:00010000:0.0:1783966777.786200:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966777.786211:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066c9b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.786228:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066c9b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.786239:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c9b expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.786246:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0031600, rc 0) 00000100:00100000:0.0:1783966777.786286:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812224:12345-0@lo:101: Request processed in 96us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.786292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783966777.786370:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812224:0@lo:101: 00010000:00010000:3.0:1783966777.786382:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.786401:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.786478:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812480:0@lo:501: 00000100:00100000:3.0:1783966777.786507:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.786535:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.786635:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812480 00000100:00100000:0.0:1783966777.786639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812480 00000100:00100000:0.0:1783966777.786658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783966777.786664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812480:12345-0@lo:501: 00000100:00100000:0.0:1783966777.786799:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812480:12345-0@lo:501: Request processed in 135us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.786806:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783966777.786916:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812480:0@lo:501: 00000100:00100000:3.0:1783966777.786957:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812608:0@lo:503: 00000100:00100000:3.0:1783966777.787000:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.787017:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.787078:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812608 00000100:00100000:0.0:1783966777.787311:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812608 00000100:00100000:0.0:1783966777.787336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783966777.787343:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812608:12345-0@lo:503: 00000100:00100000:0.0:1783966777.787441:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812608:12345-0@lo:503: Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.787457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783966777.787747:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812608:0@lo:503: 00000040:00080000:3.0:1783966777.788036:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783966777.788134:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812736:0@lo:502: 00000100:00100000:3.0:1783966777.788176:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.788203:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.788309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812736 00000100:00100000:0.0:1783966777.788314:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812736 00000100:00100000:0.0:1783966777.788351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783966777.788359:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812736:12345-0@lo:502: 00000100:00100000:0.0:1783966777.788451:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812736:12345-0@lo:502: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.788458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783966777.788544:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812736:0@lo:502: 00000040:00080000:3.0:1783966777.788736:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783966777.788759:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783966777.788806:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783966777.788820:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783966777.788831:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783966777.788842:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783966777.788869:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812864:0@lo:502: 00000100:00100000:3.0:1783966777.788904:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.788922:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.789035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812864 00000100:00100000:0.0:1783966777.789039:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812864 00000100:00100000:0.0:1783966777.789059:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783966777.789065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812864:12345-0@lo:502: 00000100:00100000:0.0:1783966777.789136:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812864:12345-0@lo:502: Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.789144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783966777.789262:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812864:0@lo:502: 00000040:00080000:3.0:1783966777.789299:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783966777.789309:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1783966777.789811:0:9522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783966777.789820:0:9522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783966777.789841:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966777.789843:0:9522:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783966777.789849:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783966777.789870:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a05f4f73380) 00000020:00000080:3.0:1783966777.789894:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783966777.789901:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783966777.789979:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05ef299800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783966777.789986:0:9522:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783966777.789992:0:9522:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b316066cb0 00010000:00010000:2.0:1783966777.797402:0:9522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1783966777.797705:0:9522:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783966777.800836:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783966777.801196:0:9522:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783966777.812805:0:9522:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783966777.813006:0:9522:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1783966777.822666:0:9522:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783966777.827199:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783966777.827215:0:9522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966777.827223:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966777.827225:0:9522:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783966777.827229:0:9522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966777.827243:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966777.827245:0:9522:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783966777.827249:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783966777.827251:0:9522:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783966777.827280:0:9522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966777.827284:0:9522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966777.827285:0:9522:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783966777.827288:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783966777.827924:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1783966777.827959:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783966777.827982:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.827995:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966777.828005:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ef299800 from 1 10000000:01000000:3.0:1783966777.828009:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783966777.828050:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.828059:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.828070:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.828118:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812992:0@lo:101: 00000100:00100000:3.0:1783966777.828188:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.828252:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.831832:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587812992 00000100:00100000:0.0:1783966777.831847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587812992 00000100:00100000:0.0:1783966777.831910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783966777.831921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:9509:x1870624587812992:12345-0@lo:101: 00010000:00010000:0.0:1783966777.831937:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966777.831955:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066cb7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.831985:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.831997:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.832016:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030400, rc 0) 00000100:00100000:0.0:1783966777.832098:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587812992:12345-0@lo:101: Request processed in 178us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.832104:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783966777.834793:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587812992:0@lo:101: 00010000:00010000:1.0:1783966777.834822:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.834836:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.834982:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813120:0@lo:501: 00000100:00100000:1.0:1783966777.835046:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.835080:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.835184:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813120 00000100:00100000:0.0:1783966777.835190:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813120 00000100:00100000:0.0:1783966777.835248:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783966777.835257:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813120:12345-0@lo:501: 00000100:00100000:0.0:1783966777.835367:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813120:12345-0@lo:501: Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.835375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783966777.835614:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813120:0@lo:501: 00000100:00100000:1.0:1783966777.835662:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813248:0@lo:503: 00000100:00100000:1.0:1783966777.835700:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.835729:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.835817:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813248 00000100:00100000:2.0:1783966777.835822:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813248 00000100:00100000:2.0:1783966777.835852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783966777.835870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813248:12345-0@lo:503: 00000100:00100000:2.0:1783966777.835957:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813248:12345-0@lo:503: Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.835964:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783966777.836050:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813248:0@lo:503: 00000040:00080000:1.0:1783966777.836384:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783966777.836456:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813376:0@lo:502: 00000100:00100000:1.0:1783966777.836498:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.836624:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.839202:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813376 00000100:00100000:2.0:1783966777.839218:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813376 00000100:00100000:2.0:1783966777.839411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783966777.839420:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813376:12345-0@lo:502: 00000100:00100000:2.0:1783966777.839650:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813376:12345-0@lo:502: Request processed in 230us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.839661:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783966777.839818:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813376:0@lo:502: 00000040:00080000:1.0:1783966777.840060:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783966777.840108:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783966777.840142:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813504:0@lo:502: 00000100:00100000:1.0:1783966777.840190:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.840223:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.840416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813504 00000100:00100000:2.0:1783966777.840422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813504 00000100:00100000:2.0:1783966777.840452:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783966777.840460:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813504:12345-0@lo:502: 00000100:00100000:2.0:1783966777.840618:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813504:12345-0@lo:502: Request processed in 157us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.840625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783966777.840738:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813504:0@lo:502: 00000040:00080000:1.0:1783966777.840808:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783966777.840817:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783966777.842176:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966777.842187:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966777.842190:0:9526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783966777.842196:0:9526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05ef299800 00000020:00000080:3.0:1783966777.842200:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783966777.842212:0:9526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966777.842215:0:9526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966777.842217:0:9526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783966777.842220:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783966777.842422:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783966777.842454:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966777.842509:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.842540:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966777.842588:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783966777.842591:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05ef299800 10000000:01000000:1.0:1783966777.842595:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05ef299800 10000000:01000000:1.0:1783966777.842599:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783966777.842604:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ef299800 from 1 10000000:01000000:1.0:1783966777.842607:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783966777.842640:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.842648:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.842659:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.842680:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813632:0@lo:101: 00000100:00100000:1.0:1783966777.842733:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.842797:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966777.842929:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813632 00000100:00100000:3.0:1783966777.842936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813632 00000100:00100000:3.0:1783966777.842982:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783966777.842992:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:9509:x1870624587813632:12345-0@lo:101: 00010000:00010000:3.0:1783966777.843004:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966777.843017:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066cc5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.843039:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.843050:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.843059:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:3.0:1783966777.843111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587813632:12345-0@lo:101: Request processed in 121us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.843126:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783966777.843254:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813632:0@lo:101: 00010000:00010000:1.0:1783966777.843267:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.843276:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.843363:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813760:0@lo:501: 00000100:00100000:1.0:1783966777.843389:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.843582:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966777.843656:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813760 00000100:00100000:3.0:1783966777.843660:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813760 00000100:00100000:3.0:1783966777.843690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783966777.843697:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587813760:12345-0@lo:501: 00000100:00100000:3.0:1783966777.843900:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587813760:12345-0@lo:501: Request processed in 203us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.843908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783966777.844038:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813760:0@lo:501: 00000100:00100000:1.0:1783966777.844067:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813888:0@lo:503: 00000100:00100000:1.0:1783966777.844118:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.844146:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966777.844191:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587813888 00000100:00100000:3.0:1783966777.844195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587813888 00000100:00100000:3.0:1783966777.844223:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783966777.844230:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587813888:12345-0@lo:503: 00000100:00100000:3.0:1783966777.844323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587813888:12345-0@lo:503: Request processed in 93us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.844329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783966777.844485:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587813888:0@lo:503: 00000040:00080000:1.0:1783966777.844799:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783966777.844873:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587814016:0@lo:502: 00000100:00100000:1.0:1783966777.844910:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.844933:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.844993:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814016 00000100:00100000:0.0:1783966777.844999:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814016 00000100:00100000:0.0:1783966777.845028:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783966777.845036:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587814016:12345-0@lo:502: 00000100:00100000:0.0:1783966777.845128:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587814016:12345-0@lo:502: Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.845135:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783966777.845737:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587814016:0@lo:502: 00000040:00080000:1.0:1783966777.845957:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783966777.845987:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783966777.846004:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783966777.846017:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783966777.846028:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783966777.846041:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783966777.846056:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783966777.846070:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783966777.846099:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783966777.846116:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783966777.846131:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783966777.846145:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783966777.846158:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783966777.846183:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783966777.846198:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783966777.846212:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783966777.846226:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783966777.846311:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783966777.846330:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783966777.846345:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783966777.846359:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783966777.846374:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783966777.846388:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783966777.846403:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783966777.846417:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1783966777.846431:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1783966777.846461:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1783966777.846478:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1783966777.846492:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1783966777.846506:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1783966777.846649:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1783966777.846671:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1783966777.846687:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1783966777.846700:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1783966777.846714:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1783966777.846727:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1783966777.846738:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1783966777.846751:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1783966777.846763:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1783966777.846799:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1783966777.846814:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1783966777.846827:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1783966777.846853:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1783966777.846882:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1783966777.846894:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1783966777.846906:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1783966777.846949:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587814144:0@lo:502: 00000100:00100000:1.0:1783966777.847014:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.847057:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966777.847189:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814144 00000100:00100000:0.0:1783966777.847197:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814144 00000100:00100000:0.0:1783966777.847315:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783966777.847324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587814144:12345-0@lo:502: 00000100:00100000:0.0:1783966777.847438:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587814144:12345-0@lo:502: Request processed in 115us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.847446:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783966777.847604:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587814144:0@lo:502: 00000040:00080000:1.0:1783966777.847655:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1783966777.847664:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1783966777.851134:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783966777.851154:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a05f55f19c0) 00000020:00000080:2.0:1783966777.851179:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1783966777.851494:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05ef299800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783966777.851499:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05ef299800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783966777.851502:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ef299800 3 00010000:00080000:2.0:1783966777.852206:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c32ff000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783966777.868672:0:9527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1783966777.868808:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783966777.869336:0:9527:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783966777.869350:0:9527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9269c8b316066cda 00000100:00080000:3.0:1783966777.869362:0:9527:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783966777.869367:0:9527:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c32ff000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966777.869470:0:9527:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c2682300 x1870624587814272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783966777.869549:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587814272:0@lo:38: 00000100:00100000:0.0:1783966777.869620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783966777.869686:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783966777.872922:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587814784:0@lo:400: 00000100:00100000:1.0:1783966777.872989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.873040:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587815296:0@lo:400: 00000100:00100000:1.0:1783966777.873078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.873126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783966777.873133:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587814656:0@lo:400: 00000100:00100000:1.0:1783966777.873157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.873174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587815168:0@lo:400: 00000100:00100000:1.0:1783966777.873193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.873234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814784 00000100:00100000:1.0:1783966777.873242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814784 00000100:00100000:1.0:1783966777.873290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783966777.873298:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587814784:12345-0@lo:400: 00000100:00100000:1.0:1783966777.873359:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587814784:12345-0@lo:400: Request processed in 61us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.873367:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783966777.873621:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815296 00000100:00100000:1.0:1783966777.873625:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815296 00000100:00100000:1.0:1783966777.873652:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815168 00000100:00100000:1.0:1783966777.873655:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815168 00000100:00100000:1.0:1783966777.873674:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783966777.873694:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587815296:12345-0@lo:400: 00000100:00100000:1.0:1783966777.873730:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587815296:12345-0@lo:400: Request processed in 37us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.873735:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783966777.873746:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966777.873752:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587815168:12345-0@lo:400: 00000100:00100000:1.0:1783966777.873800:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587815168:12345-0@lo:400: Request processed in 48us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.873806:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966777.873824:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814272 00000100:00100000:1.0:1783966777.873828:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814272 00000100:00100000:1.0:1783966777.873844:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814656 00000100:00100000:1.0:1783966777.873847:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814656 00000100:00100000:1.0:1783966777.873878:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783966777.873885:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587814656:12345-0@lo:400: 00000100:00100000:1.0:1783966777.873915:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587814656:12345-0@lo:400: Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.873921:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783966777.873933:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966777.873938:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587814272:12345-0@lo:38: 00010000:00080000:1.0:1783966777.873961:0:7847:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:1.0:1783966777.874321:0:7847:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9269c8b316066ce1 00000004:00100000:1.0:1783966777.874345:0:7847:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1783966777.874486:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587814528:0@lo:400: 00000100:00100000:0.0:1783966777.874526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.874551:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587815040:0@lo:400: 00000100:00100000:0.0:1783966777.874581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.874595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783966777.874602:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587814400:0@lo:400: 00000100:00100000:0.0:1783966777.874622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.874634:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587814912:0@lo:400: 00000100:00100000:0.0:1783966777.874678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966777.874701:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815040 00000100:00100000:0.0:1783966777.874705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815040 00000100:00100000:0.0:1783966777.874728:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814400 00000100:00100000:0.0:1783966777.874730:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814400 00000100:00100000:0.0:1783966777.874741:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814912 00000100:00100000:0.0:1783966777.874744:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814912 00000100:00100000:0.0:1783966777.874757:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783966777.874763:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587815040:12345-0@lo:400: 00000100:00100000:0.0:1783966777.874816:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587815040:12345-0@lo:400: Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.874822:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783966777.874834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783966777.874839:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587814400:12345-0@lo:400: 00000100:00100000:0.0:1783966777.874878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587814400:12345-0@lo:400: Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.874895:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783966777.874916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783966777.874921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587814912:12345-0@lo:400: 00000100:00100000:0.0:1783966777.874950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587814912:12345-0@lo:400: Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.874957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1783966777.874989:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2749c00 x1870624587814400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966777.875072:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587814400:0@lo:400: 00010000:00080000:0.0:1783966777.875087:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2748e00 x1870624587814912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966777.875097:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587814912:0@lo:400: 00010000:00080000:0.0:1783966777.875172:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2749f80 x1870624587815040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966777.875183:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587815040:0@lo:400: 00000100:00080000:1.0:1783966777.875983:0:7847:0:(import.c:65:import_set_state_nolock()) ffff9a05ef102000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966777.876061:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870624587814272:12345-0@lo:38: Request processed in 2121us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.876070:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783966777.876125:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587814528 00000100:00100000:1.0:1783966777.876130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587814528 00000100:00100000:1.0:1783966777.876158:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783966777.876165:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587814528:12345-0@lo:400: 00000100:00100000:1.0:1783966777.876208:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587814528:12345-0@lo:400: Request processed in 44us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.876216:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1783966777.877488:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2749500 x1870624587814656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.877506:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587814656:0@lo:400: 00010000:00080000:1.0:1783966777.877525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2748700 x1870624587815168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.877533:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587815168:0@lo:400: 00000100:00100000:1.0:1783966777.877545:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587814784:0@lo:400: 00010000:00080000:1.0:1783966777.877557:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c274bb80 x1870624587815296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.877566:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587815296:0@lo:400: 00000100:00100000:1.0:1783966777.877617:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587814528:0@lo:400: 00010000:00080000:1.0:1783966777.877653:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2682300 x1870624587814272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.877661:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966777.877669:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783966777.877677:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783966777.877682:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783966777.877693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783966777.877699:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587814272:0@lo:38: 00000020:01000004:2.0:1783966777.877990:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783966777.878019:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a04c3478000) 00000020:00000080:2.0:1783966777.878045:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1783966777.879527:0:9529:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9529:1870624587815424:0@lo:901: 00000020:01000004:2.0:1783966777.879534:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05ef299800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783966777.879540:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05ef299800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783966777.879543:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ef299800 3 00010000:00080000:2.0:1783966777.879580:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c32f9000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.159@tcp at head 00000100:00100000:1.0:1783966777.879602:0:9529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.879648:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815424 00000100:00100000:1.0:1783966777.879654:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815424 00000100:00100000:1.0:1783966777.879699:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783966777.879708:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9529:x1870624587815424:12345-0@lo:901: 00000100:00100000:1.0:1783966777.879834:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9529:x1870624587815424:12345-0@lo:901: Request processed in 127us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.879842:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1783966777.879873:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966777.880992:0:9529:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f7d9a6c0 going to sleep for 11 seconds 00010000:00080000:1.0:1783966777.881095:0:9529:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2748a80 x1870624587815424/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783966793 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.881178:0:9529:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9529:1870624587815424:0@lo:901: 00010000:00010000:2.0:1783966777.884892:0:9527:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1783966777.885009:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1783966777.885051:0:9527:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783966777.885064:0:9527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9269c8b316066cef 00000100:00080000:2.0:1783966777.885075:0:9527:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783966777.885080:0:9527:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a04c32f9000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966777.885377:0:9527:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7d59500 x1870624587815552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783966777.885401:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783966777.886219:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587815552:0@lo:38: 00000100:00100000:1.0:1783966777.886303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.886363:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815552 00000100:00100000:3.0:1783966777.886372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815552 00000100:00100000:3.0:1783966777.886421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783966777.886429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587815552:12345-0@lo:38: 00010000:00080000:3.0:1783966777.886456:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1783966777.886513:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9269c8b316066cf6 00000004:00100000:3.0:1783966777.886530:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783966777.886567:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a04c3159000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966777.886632:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870624587815552:12345-0@lo:38: Request processed in 202us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966777.886641:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1783966777.886648:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00010000:00080000:1.0:1783966777.886668:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7d59500 x1870624587815552/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783966787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966777.886678:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783966777.886686:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783966777.886693:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783966777.886698:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783966777.886701:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783966777.886707:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587815552:0@lo:38: 00000020:01000000:3.0:1783966777.886764:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1783966777.886911:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783966777.886925:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.886947:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783966777.886998:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783966777.887001:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.887002:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.887003:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966777.887005:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.887006:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.887008:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.887009:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966777.887010:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966777.887012:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.887013:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783966777.887017:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783966777.887020:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783966777.887021:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.887022:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.887027:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966777.887028:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.887029:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.887030:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.887031:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966777.887032:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966777.887033:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.887034:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783966777.887049:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783966777.887061:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587815680:0@lo:253: 00000100:00100000:3.0:1783966777.887098:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.887127:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.887638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815680 00000100:00100000:2.0:1783966777.887644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815680 00000100:00100000:2.0:1783966777.887694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783966777.887704:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587815680:12345-0@lo:253: 20000000:01000000:2.0:1783966777.887730:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783966777.887746:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783966777.906008:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783966777.906075:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783966777.906236:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783966777.906243:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783966777.906275:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.906297:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066bec expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.906305:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c32 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.906312:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.906900:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.906916:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 17 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.907001:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587815808:0@lo:104: 00000100:00100000:3.0:1783966777.907187:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966777.907274:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966777.907284:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 17 pid: 6511 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966777.907293:0:6534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587815936:0@lo:104: 00000100:00100000:3.0:1783966777.907315:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966777.907352:0:6534:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966777.907368:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815808 00000100:00100000:2.0:1783966777.907378:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815808 00000100:00100000:1.0:1783966777.907418:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587815936 00000100:00100000:1.0:1783966777.907424:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587815936 00000100:00100000:2.0:1783966777.907443:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966777.907452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783966777.907457:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587815808:12345-0@lo:104: 00010000:00010000:2.0:1783966777.907472:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.907476:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587815936:12345-0@lo:104: 00010000:00010000:1.0:1783966777.907492:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.907552:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783966777.907559:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587815808:12345-0@lo:104: Request processed in 107us (372us total) trans 0 rc 0/0 00010000:00010000:1.0:1783966777.907559:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783966777.907569:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:6534:x1870624587815936:12345-0@lo:104: Request processed in 107us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.907571:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966777.907581:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1783966777.907598:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783966777.907603:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966777.907607:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.907609:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.907621:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966777.907628:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.907629:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966777.907636:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.907642:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.907647:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966777.907653:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966777.907660:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966777.907662:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966777.907671:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1783966777.909197:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9509:x1870624587815680:12345-0@lo:253: Request processed in 21488us (22091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966777.909212:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783966777.909259:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8e80b464-a486-4100-b63a-6e6116a9d437:9509:1870624587815680:0@lo:253: 10000000:01000000:3.0:1783966777.909275:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783966777.909278:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783966777.909280:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783966777.909281:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783966777.909283:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783966777.909284:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783966777.909285:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783966777.909287:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783966777.909288:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783966777.909289:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783966777.909291:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783966777.909292:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783966777.909310:0:9509:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783966777.913894:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587815808:0@lo:104: 00000100:00100000:0.0:1783966777.913926:0:6534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1870624587815936:0@lo:104: 00010000:00010000:0.0:1783966777.913957:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.914799:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.914811:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966777.914821:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.914833:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966777.914874:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.914882:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630200/0x9269c8b316066c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.914903:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.914911:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587816192:0@lo:103: 00010000:00010000:1.0:1783966777.914914:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0000/0x9269c8b316066bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066bf3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.914937:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.914940:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966777.914943:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966777.914984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966777.915028:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587816064:0@lo:103: 00010000:00010000:2.0:1783966777.915041:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.915045:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966777.915047:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966777.915064:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966777.915987:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816192 00000100:00100000:2.0:1783966777.915996:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816192 00010000:00010000:2.0:1783966777.916030:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 17 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.916077:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816064 00000100:00100000:2.0:1783966777.916082:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816064 00010000:00010000:2.0:1783966777.916156:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 18 pid: 6511 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.916173:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783966777.916183:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+18:3647:x1870624587816192:12345-0@lo:103: 00000100:00100000:1.0:1783966777.916193:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1783966777.916197:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966777.916205:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 18 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966777.916205:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1783966777.916220:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 18 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.916305:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631600/0x9269c8b316066c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066c32 expref: 18 pid: 6512 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966777.916319:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966777.916369:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+17:3647:x1870624587816192:12345-0@lo:103: Request processed in 188us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966777.916377:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966777.916393:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783966777.916404:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+16:3648:x1870624587816064:12345-0@lo:103: 00010000:00010000:1.0:1783966777.916419:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966777.916425:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 16 pid: 6511 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.916515:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587816192:0@lo:103: 00010000:00010000:1.0:1783966777.916996:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 16 pid: 6511 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917017:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0600/0x9269c8b316066bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066bec expref: 16 pid: 6511 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917032:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917040:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783966777.917069:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010827252s 00010000:00010000:1.0:1783966777.917074:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917082:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917089:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917097:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917103:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966777.917107:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917114:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917139:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966777.917150:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966777.917206:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+15:3648:x1870624587816064:12345-0@lo:103: Request processed in 804us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966777.917215:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1783966777.917314:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.917330:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966777.917337:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0200/0x9269c8b316066cfd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966777.917886:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587816064:0@lo:103: 00080000:10000000:0.0:1783966777.921721:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1783966777.922509:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1783966777.923696:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1783966777.924428:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783966777.925585:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1783966777.925897:0:9509:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1783966777.930996:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1783966777.947067:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783966777.947079:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783966777.947136:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783966777.947182:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783966777.947208:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783966777.947226:0:9509:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783966777.948517:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966777.948719:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1783966778.423639:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783966778.835323:0:9584:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966778.835545:0:9584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783966779.449191:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966779.769735:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587816320:0@lo:41: 00000100:00100000:0.0:1783966779.770059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966779.771008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816320 00000100:00100000:2.0:1783966779.771087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816320 00000100:00100000:2.0:1783966779.771138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783966779.771146:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587816320:12345-0@lo:41: 00000004:00000024:2.0:1783966779.771263:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783966779.771329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587816320:12345-0@lo:41: Request processed in 183us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966779.771336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783966779.771607:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587816320:0@lo:41: 00010000:00010000:2.0:1783966780.471071:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966781.302984:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587816448:0@lo:13: 00000100:00100000:3.0:1783966781.303061:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966781.303173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816448 00000100:00100000:3.0:1783966781.303182:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816448 00000100:00100000:3.0:1783966781.303251:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783966781.303263:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587816448:12345-0@lo:13: 00002000:00000024:3.0:1783966781.303295:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966781.303350:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587816448:12345-0@lo:13: Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966781.303376:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783966781.303405:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783966781.303448:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf6680 x1870624587816448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966781.303482:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587816448:0@lo:13: 00000100:00100000:0.0:1783966781.305436:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966781.305456:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587816576:0@lo:13: 00000100:00100000:0.0:1783966781.305508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966781.305557:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816576 00000100:00100000:0.0:1783966781.305563:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816576 00000100:00100000:0.0:1783966781.305618:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783966781.305625:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587816576:12345-0@lo:13: 00002000:00000024:0.0:1783966781.305644:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966781.305680:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587816576:12345-0@lo:13: Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00080000:3.0:1783966781.305686:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966781.305690:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1783966781.305732:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef209500 x1870624587816576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966781.305747:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587816576:0@lo:13: 00010000:00010000:1.0:1783966781.499475:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966781.816008:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587816704:0@lo:41: 00000100:00100000:1.0:1783966781.816159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966781.816321:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816704 00000100:00100000:3.0:1783966781.816328:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816704 00000100:00100000:3.0:1783966781.816382:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783966781.816392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587816704:12345-0@lo:41: 00000004:00000024:3.0:1783966781.816428:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783966781.816482:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587816704:12345-0@lo:41: Request processed in 92us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966781.816490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783966781.816579:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587816704:0@lo:41: 00010000:00010000:1.0:1783966782.520763:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966783.351042:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587816960:0@lo:400: 00000100:00100000:1.0:1783966783.351111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351157:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587817472:0@lo:400: 00000100:00100000:1.0:1783966783.351181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351205:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587817984:0@lo:400: 00000100:00100000:1.0:1783966783.351240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351267:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783966783.351274:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587816832:0@lo:400: 00000100:00100000:1.0:1783966783.351305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351334:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587817344:0@lo:400: 00000100:00100000:1.0:1783966783.351356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351372:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587817856:0@lo:400: 00000100:00100000:1.0:1783966783.351395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351425:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587817088:0@lo:400: 00000100:00100000:1.0:1783966783.351448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587817600:0@lo:400: 00000100:00100000:1.0:1783966783.351483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351497:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587818112:0@lo:400: 00000100:00100000:1.0:1783966783.351512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351522:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783966783.351527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587817216:0@lo:400: 00000100:00100000:1.0:1783966783.351545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351572:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587817728:0@lo:400: 00000100:00100000:1.0:1783966783.351592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966783.351623:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816960 00000100:00100000:1.0:1783966783.351630:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816960 00000100:00100000:1.0:1783966783.351666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817472 00000100:00100000:1.0:1783966783.351668:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817472 00000100:00100000:1.0:1783966783.351690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817984 00000100:00100000:1.0:1783966783.351692:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817984 00000100:00100000:1.0:1783966783.351703:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817600 00000100:00100000:1.0:1783966783.351704:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817600 00000100:00100000:1.0:1783966783.351716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818112 00000100:00100000:1.0:1783966783.351717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818112 00000100:00100000:1.0:1783966783.351727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817216 00000100:00100000:1.0:1783966783.351729:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817216 00000100:00100000:1.0:1783966783.351742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783966783.351750:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587816960:12345-0@lo:400: 00000100:00100000:1.0:1783966783.351830:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587816960:12345-0@lo:400: Request processed in 80us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.351837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783966783.351855:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783966783.351867:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587817472:12345-0@lo:400: 00000100:00100000:1.0:1783966783.351894:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587817472:12345-0@lo:400: Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.351900:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783966783.351911:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783966783.351916:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587817984:12345-0@lo:400: 00000100:00100000:1.0:1783966783.351938:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587817984:12345-0@lo:400: Request processed in 22us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.351944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783966783.351953:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783966783.351958:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587817600:12345-0@lo:400: 00000100:00100000:1.0:1783966783.351984:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587817600:12345-0@lo:400: Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.351990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783966783.352001:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783966783.352006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587818112:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352030:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587818112:12345-0@lo:400: Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783966783.352046:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783966783.352051:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587817216:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352076:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587817216:12345-0@lo:400: Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352082:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783966783.352104:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817344 00000100:00100000:1.0:1783966783.352108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817344 00000100:00100000:1.0:1783966783.352132:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817088 00000100:00100000:1.0:1783966783.352134:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817088 00000100:00100000:1.0:1783966783.352146:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783966783.352150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587817344:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587817344:12345-0@lo:400: Request processed in 29us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783966783.352196:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783966783.352202:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587817088:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352225:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587817088:12345-0@lo:400: Request processed in 24us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783966783.352246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817856 00000100:00100000:1.0:1783966783.352249:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817856 00000100:00100000:1.0:1783966783.352272:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587817728 00000100:00100000:1.0:1783966783.352275:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587817728 00000100:00100000:1.0:1783966783.352294:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783966783.352300:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587817856:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352328:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587817856:12345-0@lo:400: Request processed in 29us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352334:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783966783.352344:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783966783.352350:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587817728:12345-0@lo:400: 00000100:00100000:1.0:1783966783.352374:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587817728:12345-0@lo:400: Request processed in 25us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.352380:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1783966783.352403:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966783.352408:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966783.352417:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966783.352446:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587817344:0@lo:400: 00010000:00080000:1.0:1783966783.352460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2749880 x1870624587817856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352471:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587817856:0@lo:400: 00010000:00080000:1.0:1783966783.352479:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274a300 x1870624587816960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352487:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587816960:0@lo:400: 00010000:00080000:1.0:1783966783.352496:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2749f80 x1870624587817472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352504:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587817472:0@lo:400: 00010000:00080000:1.0:1783966783.352513:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1a27100 x1870624587817984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352520:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587817984:0@lo:400: 00010000:00080000:1.0:1783966783.352554:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2748000 x1870624587817216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352562:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587817216:0@lo:400: 00010000:00080000:1.0:1783966783.352572:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2749c00 x1870624587817728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587817728:0@lo:400: 00000100:00100000:1.0:1783966783.352589:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587817088:0@lo:400: 00010000:00080000:1.0:1783966783.352597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2748e00 x1870624587817600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352612:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587817600:0@lo:400: 00010000:00080000:1.0:1783966783.352625:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1abad80 x1870624587818112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966783.352631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587818112:0@lo:400: 00000100:00100000:1.0:1783966783.354367:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587816832 00000100:00100000:1.0:1783966783.354378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587816832 00000100:00100000:1.0:1783966783.354437:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783966783.354447:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:3646:x1870624587816832:12345-0@lo:400: 00000100:00100000:1.0:1783966783.354523:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+15:3646:x1870624587816832:12345-0@lo:400: Request processed in 78us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966783.354530:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783966783.354593:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587816832:0@lo:400: 00010000:00010000:0.0:1783966783.547421:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783966783.887911:0:9874:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783966784.574163:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783966784.816554:0:9926:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783966784.817030:0:9926:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783966784.887983:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966784.888021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587818240:0@lo:41: 00000100:00100000:0.0:1783966784.888118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966784.888202:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818240 00000100:00100000:0.0:1783966784.888212:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818240 00000100:00100000:0.0:1783966784.888272:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783966784.888283:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587818240:12345-0@lo:41: 00000004:00000024:0.0:1783966784.888344:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783966784.888403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587818240:12345-0@lo:41: Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966784.888410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783966784.889086:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587818240:0@lo:41: 00010000:00010000:2.0:1783966785.591680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783966786.423721:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783966786.423729:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05fcff3800 from 39 10000000:01000000:0.0:1783966786.423734:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783966786.423767:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.423794:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.423806:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.423828:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818496:0@lo:101: 00000100:00100000:0.0:1783966786.423912:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.423965:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.423987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818496 00000100:00100000:0.0:1783966786.423994:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818496 00000100:00100000:0.0:1783966786.424062:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783966786.424072:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587818496:12345-0@lo:101: 00010000:00010000:0.0:1783966786.424086:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966786.424100:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d04 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.424125:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d04 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.424137:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d04 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.424147:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0031000, rc 0) 00000100:00100000:0.0:1783966786.424186:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587818496:12345-0@lo:101: Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.424193:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783966786.424241:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818496:0@lo:101: 00010000:00010000:0.0:1783966786.424256:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.424266:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.424326:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818624:0@lo:501: 00000100:00100000:0.0:1783966786.424361:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.424373:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.426029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587818368:0@lo:13: 00000100:00100000:3.0:1783966786.426100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.426145:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966786.426151:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587818752:0@lo:13: 00000100:00100000:3.0:1783966786.426173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.426209:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818624 00000100:00100000:3.0:1783966786.426215:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818624 00000100:00100000:3.0:1783966786.426255:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783966786.426264:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587818624:12345-0@lo:501: 00000100:00100000:3.0:1783966786.426414:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587818624:12345-0@lo:501: Request processed in 151us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.426438:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783966786.426472:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818368 00000100:00100000:3.0:1783966786.426476:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818368 00000100:00100000:3.0:1783966786.426500:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818752 00000100:00100000:3.0:1783966786.426503:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818752 00000100:00100000:3.0:1783966786.426517:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783966786.426523:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587818368:12345-0@lo:13: 00002000:00000024:3.0:1783966786.426544:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966786.426581:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587818368:12345-0@lo:13: Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.426588:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783966786.426600:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783966786.426607:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587818752:12345-0@lo:13: 00002000:00000024:3.0:1783966786.426615:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966786.426639:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587818752:12345-0@lo:13: Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.426644:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783966786.426675:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4000 x1870624587818752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.426705:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587818752:0@lo:13: 00010000:00080000:3.0:1783966786.426719:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef209500 x1870624587818368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.426732:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587818368:0@lo:13: 00000100:00100000:3.0:1783966786.426767:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818624:0@lo:501: 00000100:00100000:3.0:1783966786.426830:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818880:0@lo:503: 00000100:00100000:3.0:1783966786.426877:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.426899:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.426910:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587818880 00000100:00100000:3.0:1783966786.426913:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587818880 00000100:00100000:3.0:1783966786.426935:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783966786.426941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587818880:12345-0@lo:503: 00000100:00100000:3.0:1783966786.427015:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587818880:12345-0@lo:503: Request processed in 74us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.427022:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783966786.427062:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587818880:0@lo:503: 00000100:00080000:1.0:1783966786.427281:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966786.427680:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9978:1870624587819008:0@lo:502: 00000100:00100000:2.0:1783966786.427731:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.427764:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699840 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.427829:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819008 00000100:00100000:0.0:1783966786.427833:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819008 00000100:00100000:0.0:1783966786.427869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783966786.427877:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:9978:x1870624587819008:12345-0@lo:502: 00000100:00100000:0.0:1783966786.427971:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:9978:x1870624587819008:12345-0@lo:502: Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.427978:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783966786.428055:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9978:1870624587819008:0@lo:502: 00000100:00100000:2.0:1783966786.428105:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9978:1870624587819136:0@lo:502: 00000100:00100000:2.0:1783966786.428132:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.428158:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699840 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.428261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819136 00000100:00100000:0.0:1783966786.428266:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819136 00000100:00100000:0.0:1783966786.428297:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783966786.428305:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:9978:x1870624587819136:12345-0@lo:502: 00000100:00100000:0.0:1783966786.428386:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:9978:x1870624587819136:12345-0@lo:502: Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.428393:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783966786.428522:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9978:1870624587819136:0@lo:502: 00000040:00080000:2.0:1783966786.428540:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783966786.428899:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783966786.428924:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783966786.428933:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.428944:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966786.428953:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783966786.428956:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1783966786.428959:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783966786.428983:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.428998:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.429007:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.429020:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef209f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819264:0@lo:101: 00000100:00100000:0.0:1783966786.429051:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.429164:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321780 going to sleep for 11 seconds 00000100:00100000:2.0:1783966786.430719:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819264 00000100:00100000:2.0:1783966786.430729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819264 00000100:00100000:2.0:1783966786.430797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783966786.430806:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587819264:12345-0@lo:101: 00010000:00010000:2.0:1783966786.430819:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966786.430834:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d12 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.430877:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d12 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.430889:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d12 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.430898:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631000, rc 0) 00000100:00100000:2.0:1783966786.430968:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819264:12345-0@lo:101: Request processed in 163us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.430975:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783966786.431131:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef209f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819264:0@lo:101: 00010000:00010000:3.0:1783966786.431148:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.431157:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.431223:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819392:0@lo:501: 00000100:00100000:3.0:1783966786.431258:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.431293:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.431463:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819392 00000100:00100000:0.0:1783966786.431469:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819392 00000100:00100000:0.0:1783966786.431503:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783966786.431511:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819392:12345-0@lo:501: 00000100:00100000:0.0:1783966786.431640:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819392:12345-0@lo:501: Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.431648:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783966786.433512:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819392:0@lo:501: 00000100:00100000:1.0:1783966786.433614:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819520:0@lo:503: 00000100:00100000:1.0:1783966786.433729:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.433809:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3298540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.433930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819520 00000100:00100000:0.0:1783966786.433936:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819520 00000100:00100000:0.0:1783966786.433985:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783966786.433994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819520:12345-0@lo:503: 00000100:00100000:0.0:1783966786.434128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819520:12345-0@lo:503: Request processed in 134us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.434137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783966786.434320:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819520:0@lo:503: 00000100:00100000:2.0:1783966786.434993:0:9979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9979:1870624587819648:0@lo:502: 00000100:00100000:2.0:1783966786.435037:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.435081:0:9979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699000 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.435180:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819648 00000100:00100000:3.0:1783966786.435185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819648 00000100:00100000:3.0:1783966786.435219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783966786.435226:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9979:x1870624587819648:12345-0@lo:502: 00000100:00100000:3.0:1783966786.435324:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:9979:x1870624587819648:12345-0@lo:502: Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.435331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783966786.435473:0:9979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9979:1870624587819648:0@lo:502: 00000020:01000000:2.0:1783966786.435495:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966786.435504:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966786.435506:0:9979:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783966786.435512:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783966786.435513:0:9979:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783966786.435529:0:9979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9979:1870624587819776:0@lo:502: 00000100:00100000:2.0:1783966786.435563:0:9979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.435588:0:9979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699000 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.435636:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819776 00000100:00100000:3.0:1783966786.435640:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819776 00000100:00100000:3.0:1783966786.435678:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783966786.435685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:9979:x1870624587819776:12345-0@lo:502: 00000100:00100000:3.0:1783966786.435766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:9979:x1870624587819776:12345-0@lo:502: Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.435796:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783966786.435929:0:9979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9979:1870624587819776:0@lo:502: 00000020:01000000:1.0:1783966786.435948:0:9979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966786.435952:0:9979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966786.435953:0:9979:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783966786.435958:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783966786.436586:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783966786.436612:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783966786.436622:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.436634:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966786.436644:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783966786.436646:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f1a14000 from 39 10000000:01000000:3.0:1783966786.436649:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966786.437005:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.437014:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.437022:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.437039:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819904:0@lo:101: 00000100:00100000:3.0:1783966786.437163:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.437235:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966786.441729:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587819904 00000100:00100000:2.0:1783966786.441746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587819904 00000100:00100000:2.0:1783966786.441852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783966786.441865:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587819904:12345-0@lo:101: 00010000:00010000:2.0:1783966786.441883:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966786.441915:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d20 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.441947:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d20 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.441960:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d20 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.441970:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783966786.442057:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587819904:12345-0@lo:101: Request processed in 196us (4893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.442206:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587819904:0@lo:101: 00010000:00010000:1.0:1783966786.442224:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.442235:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966786.442311:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820032:0@lo:501: 00000100:00100000:1.0:1783966786.442363:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.442388:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966786.442615:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783966786.442645:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820032 00000100:00100000:2.0:1783966786.442650:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820032 00000100:00100000:2.0:1783966786.442679:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783966786.442685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587820032:12345-0@lo:501: 00000100:00100000:2.0:1783966786.442848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587820032:12345-0@lo:501: Request processed in 163us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.442855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783966786.443007:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820032:0@lo:501: 00000100:00100000:1.0:1783966786.443037:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820160:0@lo:503: 00000100:00100000:1.0:1783966786.443092:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.443122:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.443227:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820160 00000100:00100000:3.0:1783966786.443232:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820160 00000100:00100000:3.0:1783966786.443267:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783966786.443275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587820160:12345-0@lo:503: 00000100:00100000:3.0:1783966786.443363:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587820160:12345-0@lo:503: Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.443371:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783966786.443601:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820160:0@lo:503: 00000100:00100000:1.0:1783966786.444177:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9980:1870624587820288:0@lo:502: 00000100:00100000:1.0:1783966786.444244:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.444281:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.444455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820288 00000100:00100000:3.0:1783966786.444461:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820288 00000100:00100000:3.0:1783966786.444507:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783966786.444516:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:9980:x1870624587820288:12345-0@lo:502: 00000100:00100000:3.0:1783966786.444632:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:9980:x1870624587820288:12345-0@lo:502: Request processed in 117us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.444641:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783966786.444885:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9980:1870624587820288:0@lo:502: 00000100:00100000:2.0:1783966786.444934:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9980:1870624587820416:0@lo:502: 00000100:00100000:2.0:1783966786.444971:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.444991:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.445091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820416 00000100:00100000:0.0:1783966786.445097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820416 00000100:00100000:0.0:1783966786.445117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783966786.445123:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:9980:x1870624587820416:12345-0@lo:502: 00000100:00100000:0.0:1783966786.445206:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:9980:x1870624587820416:12345-0@lo:502: Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.445213:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783966786.445928:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9980:1870624587820416:0@lo:502: 00000040:00080000:2.0:1783966786.445957:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1783966786.446270:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1783966786.446295:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783966786.446307:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.446318:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966786.446329:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783966786.446332:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05f1a14000 from 6 10000000:01000000:3.0:1783966786.446347:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783966786.446379:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.446388:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.446407:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.446424:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820544:0@lo:101: 00000100:00100000:3.0:1783966786.446470:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.446636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820544 00000100:00100000:0.0:1783966786.446641:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820544 00000100:00100000:0.0:1783966786.446705:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783966786.446713:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587820544:12345-0@lo:101: 00010000:00010000:0.0:1783966786.446723:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966786.446736:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0030200/0x9269c8b316066d35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d2e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.446756:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0030200/0x9269c8b316066d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d2e expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.446765:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0030200/0x9269c8b316066d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d2e expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.446809:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030200, rc 0) 00000100:00100000:0.0:1783966786.446843:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587820544:12345-0@lo:101: Request processed in 131us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.446849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783966786.447206:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.447224:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820544:0@lo:101: 00010000:00010000:3.0:1783966786.447239:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.447247:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.447294:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820672:0@lo:256: 00000100:00100000:3.0:1783966786.447326:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.447362:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966786.447464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820672 00000100:00100000:1.0:1783966786.447469:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820672 00000100:00100000:1.0:1783966786.447544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783966786.447552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587820672:12345-0@lo:256: 20000000:01000000:1.0:1783966786.447568:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783966786.447585:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783966786.447588:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783966786.447689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587820672:12345-0@lo:256: Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.447712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783966786.447801:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820672:0@lo:256: 10000000:01000000:3.0:1783966786.447841:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783966786.447846:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.447854:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966786.447861:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1783966786.447863:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1783966786.447871:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783966786.447889:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.447896:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.447905:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.447916:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820800:0@lo:101: 00000100:00100000:3.0:1783966786.447938:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.449822:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.451890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820800 00000100:00100000:0.0:1783966786.451904:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820800 00000100:00100000:0.0:1783966786.451965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783966786.451975:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587820800:12345-0@lo:101: 00010000:00010000:0.0:1783966786.451993:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966786.452012:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d3c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.452060:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d3c expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.452085:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d3c expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.452095:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0031200, rc 0) 00000100:00100000:0.0:1783966786.452167:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587820800:12345-0@lo:101: Request processed in 193us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.452174:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783966786.452307:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820800:0@lo:101: 00010000:00010000:3.0:1783966786.452327:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966786.452350:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966786.452429:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820928:0@lo:501: 00000100:00100000:3.0:1783966786.452466:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.452516:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.452824:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587820928 00000100:00100000:0.0:1783966786.452829:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587820928 00000100:00100000:0.0:1783966786.452850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783966786.452856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587820928:12345-0@lo:501: 00000100:00100000:0.0:1783966786.452975:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587820928:12345-0@lo:501: Request processed in 118us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.452982:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783966786.453072:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587820928:0@lo:501: 00000100:00100000:3.0:1783966786.453100:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821056:0@lo:503: 00000100:00100000:3.0:1783966786.453139:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.453166:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.453212:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821056 00000100:00100000:0.0:1783966786.453216:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821056 00000100:00100000:0.0:1783966786.453233:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783966786.453237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587821056:12345-0@lo:503: 00000100:00100000:0.0:1783966786.453323:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587821056:12345-0@lo:503: Request processed in 85us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.453330:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783966786.453496:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821056:0@lo:503: 00000100:00100000:3.0:1783966786.454202:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9981:1870624587821184:0@lo:502: 00000100:00100000:3.0:1783966786.454245:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.454276:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3300 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.455927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821184 00000100:00100000:0.0:1783966786.455940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821184 00000100:00100000:0.0:1783966786.455999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783966786.456021:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:9981:x1870624587821184:12345-0@lo:502: 00000100:00100000:0.0:1783966786.456350:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:9981:x1870624587821184:12345-0@lo:502: Request processed in 331us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.456358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783966786.461245:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9981:1870624587821184:0@lo:502: 00000020:01000000:3.0:1783966786.461294:0:9981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783966786.461301:0:9981:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783966786.461310:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966786.461312:0:9981:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783966786.461318:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783966786.461322:0:9981:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:3.0:1783966786.461414:0:9981:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783966786.461418:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783966786.461436:0:9981:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a05f4f74d40) 00000020:00000080:3.0:1783966786.461462:0:9981:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1783966786.461468:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783966786.461635:0:9981:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783966786.461643:0:9981:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783966786.461652:0:9981:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316066d51 00010000:00080000:3.0:1783966786.461688:0:9981:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1ce3000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783966786.462048:0:9981:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1783966786.462255:0:9981:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783966786.462268:0:9981:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783966786.463649:0:9981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966786.464349:0:9981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783966786.464582:0:9981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783966786.464668:0:9981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783966786.465286:0:9982:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783966786.465291:0:9982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783966786.466649:0:9981:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783966786.466662:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783966786.466715:0:9981:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783966786.466741:0:9981:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066d58 00000100:00080000:0.0:1783966786.466752:0:9981:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783966786.466758:0:9981:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a04c1ce3000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966786.466907:0:9981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef20b800 x1870624587821312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783966786.466935:0:9981:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783966786.467005:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587821312:0@lo:8: 00000100:00100000:1.0:1783966786.467089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1783966786.467260:0:9981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966786.467264:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966786.467266:0:9981:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783966786.467269:0:9981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966786.467272:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966786.467274:0:9981:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783966786.467276:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783966786.467278:0:9981:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783966786.467302:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9981:1870624587821440:0@lo:502: 00000100:00100000:0.0:1783966786.467364:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.467378:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966786.467478:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821440 00000100:00100000:1.0:1783966786.467485:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821440 00000100:00100000:1.0:1783966786.467540:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783966786.467550:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:9981:x1870624587821440:12345-0@lo:502: 00000100:00100000:1.0:1783966786.467675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:9981:x1870624587821440:12345-0@lo:502: Request processed in 127us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.467683:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966786.467894:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9981:1870624587821440:0@lo:502: 00000020:01000000:0.0:1783966786.467920:0:9981:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966786.467925:0:9981:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966786.467926:0:9981:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783966786.467935:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1783966786.468082:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1783966786.468103:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783966786.468112:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.468122:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966786.468132:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783966786.468135:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ed1cf800 from 39 10000000:01000000:1.0:1783966786.468138:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783966786.468161:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.468169:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.468178:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966786.468196:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821568:0@lo:101: 00000100:00100000:1.0:1783966786.468223:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.468258:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.468359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821568 00000100:00100000:0.0:1783966786.468364:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821568 00000100:00100000:0.0:1783966786.468398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966786.468406:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587821568:12345-0@lo:101: 00010000:00010000:0.0:1783966786.468415:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966786.468428:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d5f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.468448:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d5f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.468459:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d5f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.468468:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c1536200, rc 0) 00000100:00100000:0.0:1783966786.468617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587821568:12345-0@lo:101: Request processed in 211us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.468624:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966786.468660:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821568:0@lo:101: 00010000:00010000:0.0:1783966786.468673:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.468681:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.468741:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821696:0@lo:501: 00000100:00100000:0.0:1783966786.468767:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.468808:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.468826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821696 00000100:00100000:0.0:1783966786.468829:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821696 00000100:00100000:0.0:1783966786.468848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783966786.468853:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587821696:12345-0@lo:501: 00000100:00100000:0.0:1783966786.468952:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587821696:12345-0@lo:501: Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.468959:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783966786.468984:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821696:0@lo:501: 00000100:00100000:0.0:1783966786.469005:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821824:0@lo:503: 00000100:00100000:0.0:1783966786.469036:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.469047:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.469056:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821824 00000100:00100000:0.0:1783966786.469059:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821824 00000100:00100000:0.0:1783966786.469145:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783966786.469151:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587821824:12345-0@lo:503: 00000100:00100000:0.0:1783966786.469215:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587821824:12345-0@lo:503: Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.469221:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783966786.469254:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587821824:0@lo:503: 00000100:00100000:3.0:1783966786.469527:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821312 00000100:00100000:3.0:1783966786.469538:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821312 00000100:00100000:3.0:1783966786.469563:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783966786.469567:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624587821312:12345-0@lo:8: 00010000:00080000:3.0:1783966786.469591:0:8432:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1783966786.469620:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316066d6d 00002000:00100000:3.0:1783966786.469633:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c375f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1783966786.469638:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1783966786.469642:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783966786.469711:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783966786.469969:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1783966786.469994:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a04c3758800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966786.470044:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587821312:12345-0@lo:8: Request processed in 475us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.470052:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1783966786.470107:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef20b800 x1870624587821312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783966796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.470117:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783966786.470123:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783966786.470130:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783966786.470135:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783966786.470137:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1ce3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783966786.470401:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587821952:0@lo:400: 00000100:00100000:2.0:1783966786.470446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.470469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587822464:0@lo:400: 00000100:00100000:2.0:1783966786.470491:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.473895:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783966786.473915:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587822080:0@lo:400: 00000100:00100000:2.0:1783966786.473977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.474002:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587822592:0@lo:400: 00000100:00100000:2.0:1783966786.474028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.474179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822080 00000100:00100000:0.0:1783966786.474187:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822080 00000100:00100000:0.0:1783966786.474233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783966786.474242:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587822080:12345-0@lo:400: 00000100:00100000:2.0:1783966786.474319:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587822208:0@lo:400: 00000100:00100000:2.0:1783966786.474366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.474387:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587822720:0@lo:400: 00000100:00100000:2.0:1783966786.474411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.474425:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783966786.474431:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587822336:0@lo:400: 00000100:00100000:2.0:1783966786.474451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.474463:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587822848:0@lo:400: 00000100:00100000:2.0:1783966786.475046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.475092:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587821952 00000100:00100000:2.0:1783966786.475098:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587821952 00000100:00100000:2.0:1783966786.475124:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822464 00000100:00100000:2.0:1783966786.475128:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822464 00000100:00100000:2.0:1783966786.475152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822592 00000100:00100000:2.0:1783966786.475155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822592 00000100:00100000:2.0:1783966786.475166:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822208 00000100:00100000:2.0:1783966786.475168:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822208 00000100:00100000:2.0:1783966786.475178:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822720 00000100:00100000:2.0:1783966786.475180:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822720 00000100:00100000:2.0:1783966786.475191:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822848 00000100:00100000:2.0:1783966786.475201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822848 00000100:00100000:2.0:1783966786.475220:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783966786.475228:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587821952:12345-0@lo:400: 00000004:00080000:3.0:1783966786.475963:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783966786.475974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587821312:0@lo:8: 00000004:00080000:3.0:1783966786.476006:0:9982:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783966786.476090:0:9982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 262677319557ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783966786.476097:0:9982:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783966786.476253:0:9983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587822976:0@lo:700: 00000100:00100000:1.0:1783966786.476297:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.476329:0:9983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.476665:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822976 00000100:00100000:3.0:1783966786.476682:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822976 00000100:00100000:3.0:1783966786.476822:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783966786.476832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9983:x1870624587822976:12345-0@lo:700: 00000100:00100000:3.0:1783966786.476866:0:8441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1870624587823104:0@lo:700: 00000100:00100000:3.0:1783966786.476915:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.476935:0:8441:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.476954:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823104 00000100:00100000:3.0:1783966786.476958:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823104 00000100:00100000:3.0:1783966786.476988:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783966786.476995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+6:8441:x1870624587823104:12345-0@lo:700: 00000100:00100000:0.0:1783966786.477918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587822080:12345-0@lo:400: Request processed in 3673us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.477930:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783966786.477964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587822336 00000100:00100000:0.0:1783966786.477968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587822336 00000100:00100000:0.0:1783966786.477989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783966786.477996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587822336:12345-0@lo:400: 00000100:00100000:0.0:1783966786.478160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587822336:12345-0@lo:400: Request processed in 163us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.478166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783966786.478821:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587821952:12345-0@lo:400: Request processed in 3592us (8373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.478832:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783966786.478854:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783966786.478865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587822464:12345-0@lo:400: 00000100:00100000:2.0:1783966786.478907:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587822464:12345-0@lo:400: Request processed in 46us (8416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.478913:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783966786.478925:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966786.478932:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587822592:12345-0@lo:400: 00000100:00100000:2.0:1783966786.478960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587822592:12345-0@lo:400: Request processed in 30us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.478966:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966786.478980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966786.478986:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587822208:12345-0@lo:400: 00000100:00100000:2.0:1783966786.479014:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587822208:12345-0@lo:400: Request processed in 29us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.479020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966786.479030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783966786.479036:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3645:x1870624587822720:12345-0@lo:400: 00000100:00100000:2.0:1783966786.479077:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3645:x1870624587822720:12345-0@lo:400: Request processed in 28us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.479083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783966786.479103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783966786.479109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587822848:12345-0@lo:400: 00000100:00100000:2.0:1783966786.479141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587822848:12345-0@lo:400: Request processed in 32us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.479147:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1783966786.479176:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783966786.479182:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966786.479185:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966786.480241:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587822336:0@lo:400: 00010000:00080000:1.0:1783966786.480260:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5a300 x1870624587822848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.480272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587822848:0@lo:400: 00010000:00080000:1.0:1783966786.480283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5ad80 x1870624587822208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.480292:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587822208:0@lo:400: 00010000:00080000:1.0:1783966786.480304:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d59180 x1870624587822720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.480312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587822720:0@lo:400: 00000004:00080000:0.0:1783966786.480483:0:7449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1783966786.480753:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9984:1870624587823232:0@lo:502: 00000100:00100000:1.0:1783966786.480833:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.480866:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.480933:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823232 00000100:00100000:0.0:1783966786.480938:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823232 00000100:00100000:0.0:1783966786.480972:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783966786.480980:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:9984:x1870624587823232:12345-0@lo:502: 00000100:00100000:0.0:1783966786.481093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:9984:x1870624587823232:12345-0@lo:502: Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.481100:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783966786.481249:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587822080:0@lo:400: 00010000:00080000:3.0:1783966786.481266:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d58380 x1870624587822592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.481276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587822592:0@lo:400: 00010000:00080000:3.0:1783966786.481286:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d58700 x1870624587821952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.481293:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587821952:0@lo:400: 00010000:00080000:3.0:1783966786.481304:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5b100 x1870624587822464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.481311:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587822464:0@lo:400: 00000100:00100000:1.0:1783966786.481449:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9984:1870624587823232:0@lo:502: 00000100:00100000:1.0:1783966786.481492:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9984:1870624587823360:0@lo:502: 00000100:00100000:1.0:1783966786.481599:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.481638:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.481687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823360 00000100:00100000:0.0:1783966786.481701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823360 00000100:00100000:0.0:1783966786.481797:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783966786.481806:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:9984:x1870624587823360:12345-0@lo:502: 00000100:00100000:0.0:1783966786.481883:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:9984:x1870624587823360:12345-0@lo:502: Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.481890:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783966786.482004:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9984:1870624587823360:0@lo:502: 00000040:00080000:3.0:1783966786.482025:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783966786.482267:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783966786.482291:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783966786.482300:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.482311:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966786.482320:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783966786.482322:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05ed1cf800 from 6 10000000:01000000:2.0:1783966786.482325:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783966786.482359:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.482368:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.482377:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966786.482390:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823488:0@lo:101: 00000100:00100000:2.0:1783966786.482421:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:3.0:1783966786.484467:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1783966786.485835:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966786.488385:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823488 00000100:00100000:1.0:1783966786.488400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823488 00000100:00100000:1.0:1783966786.488990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783966786.489003:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587823488:12345-0@lo:101: 00010000:00010000:1.0:1783966786.489019:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966786.489038:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63800/0x9269c8b316066d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d74 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.489080:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63800/0x9269c8b316066d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d74 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.489093:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63800/0x9269c8b316066d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d74 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.489102:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63800, rc 0) 00000100:00100000:1.0:1783966786.489173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587823488:12345-0@lo:101: Request processed in 173us (6751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.489180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783966786.491233:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1870624587823104:12345-0@lo:700: Request processed in 14232us (14311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.491263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783966786.491323:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7800 x1870624587823104/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.491351:0:8441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1870624587823104:0@lo:700: 40000000:02000000:3.0:1783966786.491569:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1783966786.492256:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823488:0@lo:101: 00010000:00010000:2.0:1783966786.492279:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966786.492291:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966786.492451:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823616:0@lo:256: 00000100:00100000:2.0:1783966786.492574:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.492619:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.492739:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823616 00000100:00100000:0.0:1783966786.492746:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823616 00000100:00100000:0.0:1783966786.492805:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783966786.492815:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587823616:12345-0@lo:256: 20000000:01000000:0.0:1783966786.492834:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783966786.492852:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783966786.492859:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783966786.492948:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587823616:12345-0@lo:256: Request processed in 133us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.492955:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783966786.492991:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823616:0@lo:256: 10000000:01000000:0.0:1783966786.493036:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783966786.493044:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493053:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966786.493062:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783966786.493131:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783966786.493135:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783966786.493159:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493166:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493175:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.493187:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823744:0@lo:101: 00000100:00100000:0.0:1783966786.493214:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.493232:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.493243:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823744 00000100:00100000:0.0:1783966786.493247:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823744 00000100:00100000:0.0:1783966786.493265:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783966786.493279:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587823744:12345-0@lo:101: 00010000:00010000:0.0:1783966786.493288:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966786.493300:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066d82 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493319:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066d82 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493329:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d82 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.493870:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c1536800, rc 0) 00000100:00100000:0.0:1783966786.493908:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587823744:12345-0@lo:101: Request processed in 629us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.493915:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783966786.493995:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823744:0@lo:101: 00010000:00010000:1.0:1783966786.494009:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.494019:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966786.494089:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823872:0@lo:501: 00000100:00100000:1.0:1783966786.494121:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.494150:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.494262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587823872 00000100:00100000:0.0:1783966786.494267:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587823872 00000100:00100000:0.0:1783966786.494302:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783966786.494309:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587823872:12345-0@lo:501: 00000100:00100000:0.0:1783966786.495293:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587823872:12345-0@lo:501: Request processed in 981us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.495302:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783966786.495469:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587823872:0@lo:501: 00000100:00100000:2.0:1783966786.495525:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824000:0@lo:503: 00000100:00100000:2.0:1783966786.495573:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966786.495600:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966786.495707:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824000 00000100:00100000:0.0:1783966786.495712:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824000 00000100:00100000:0.0:1783966786.495747:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783966786.495754:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587824000:12345-0@lo:503: 00000100:00100000:0.0:1783966786.495851:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587824000:12345-0@lo:503: Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.495866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783966786.495902:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824000:0@lo:503: 00000100:00100000:0.0:1783966786.500271:0:9985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9985:1870624587824128:0@lo:502: 00000100:00100000:0.0:1783966786.501742:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.502158:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824128 00000100:00100000:1.0:1783966786.502166:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824128 00000100:00100000:1.0:1783966786.502222:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783966786.502231:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:9985:x1870624587824128:12345-0@lo:502: 00000100:00100000:1.0:1783966786.502377:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:9985:x1870624587824128:12345-0@lo:502: Request processed in 147us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.502386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783966786.502436:0:9985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966786.502459:0:9985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9985:1870624587824128:0@lo:502: 00000020:01000000:1.0:1783966786.502487:0:9985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783966786.502495:0:9985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783966786.503263:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966786.503267:0:9985:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783966786.503275:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783966786.503279:0:9985:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1783966786.503302:0:9985:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783966786.503305:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783966786.503322:0:9985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a04c1fdb380) 00000020:00000080:1.0:1783966786.503571:0:9985:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1783966786.503580:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783966786.504172:0:9985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783966786.504179:0:9985:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1783966786.504186:0:9985:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316066d97 00010000:00080000:1.0:1783966786.504218:0:9985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3696800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783966786.504908:0:9985:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1783966786.505033:0:9985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783966786.505045:0:9985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783966786.506152:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966786.506266:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783966786.507631:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783966786.507760:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1783966786.510900:0:9986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783966786.510908:0:9986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:3.0:1783966786.511156:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783966786.511455:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587822976:12345-0@lo:700: Request processed in 34620us (35153us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.511469:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783966786.511762:0:9983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0700 x1870624587822976/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.511795:0:9983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587822976:0@lo:700: 00000020:00000080:1.0:1783966786.512493:0:9985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783966786.512569:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783966786.512609:0:9985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783966786.512634:0:9985:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066d9e 00000100:00080000:1.0:1783966786.512643:0:9985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783966786.512648:0:9985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c3696800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783966786.512747:0:9985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c36b0700 x1870624587824256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783966786.512790:0:9985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783966786.512818:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587824256:0@lo:8: 00000100:00100000:3.0:1783966786.512876:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783966786.512903:0:9985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966786.512909:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966786.512911:0:9985:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783966786.512915:0:9985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966786.512919:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966786.512920:0:9985:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783966786.512923:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783966786.512926:0:9985:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783966786.512937:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824256 00000100:00100000:3.0:1783966786.512944:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824256 00000100:00100000:1.0:1783966786.512951:0:9985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9985:1870624587824384:0@lo:502: 00000100:00100000:3.0:1783966786.512977:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783966786.512985:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587824256:12345-0@lo:8: 00000100:00100000:1.0:1783966786.512999:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783966786.513012:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000100:00100000:1.0:1783966786.513020:0:9985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f564ae40 going to sleep for 11 seconds 00000020:00000080:3.0:1783966786.513039:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316066da5 00002000:00100000:3.0:1783966786.513053:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a04c375a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783966786.513058:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1783966786.513061:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783966786.513187:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824384 00000100:00100000:2.0:1783966786.513192:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824384 00000100:00100000:2.0:1783966786.513264:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783966786.513272:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:9985:x1870624587824384:12345-0@lo:502: 00000100:00100000:2.0:1783966786.513411:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:9985:x1870624587824384:12345-0@lo:502: Request processed in 138us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.513421:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00002000:00080000:3.0:1783966786.513425:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783966786.513451:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a04c375c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966786.513497:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587824256:12345-0@lo:8: Request processed in 511us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.513505:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783966786.513509:0:9985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:9985:1870624587824384:0@lo:502: 00000020:01000000:0.0:1783966786.513540:0:9985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:3.0:1783966786.513544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0700 x1870624587824256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783966796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1783966786.513546:0:9985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966786.513550:0:9985:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783966786.513556:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:3.0:1783966786.513560:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783966786.513576:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783966786.513584:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783966786.513589:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783966786.513592:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3696800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783966786.513609:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:0.0:1783966786.513612:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00000100:00100000:3.0:1783966786.513616:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587824256:0@lo:8: 10000000:01000000:0.0:1783966786.513641:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783966786.513651:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.513674:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966786.513684:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783966786.513687:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:0.0:1783966786.513701:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783966786.513726:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.513735:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.513745:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966786.513803:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824512:0@lo:101: 00000100:00100000:0.0:1783966786.513835:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.514229:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47240 going to sleep for 11 seconds 00000100:00100000:1.0:1783966786.514322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824512 00000100:00100000:1.0:1783966786.514328:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824512 00000100:00100000:1.0:1783966786.514416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783966786.514424:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587824512:12345-0@lo:101: 00010000:00010000:1.0:1783966786.514433:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966786.514444:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066dac expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.514465:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066dac expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.514474:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066dac expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.514481:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62600, rc 0) 00000004:00080000:0.0:1783966786.514829:0:9986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783966786.516659:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 262717887046ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783966786.516672:0:9986:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783966786.519491:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587824512:12345-0@lo:101: Request processed in 5059us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966786.519516:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783966786.519598:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824512:0@lo:101: 00010000:00010000:1.0:1783966786.519622:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966786.519636:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966786.519863:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824768:0@lo:501: 00000100:00100000:3.0:1783966786.519865:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587824640:0@lo:13: 00000100:00100000:1.0:1783966786.519918:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.519924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.519961:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea606f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.519982:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824640 00000100:00100000:1.0:1783966786.519985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824768 00000100:00100000:3.0:1783966786.519989:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824640 00000100:00100000:1.0:1783966786.519991:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824768 00000100:00100000:1.0:1783966786.520027:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783966786.520044:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783966786.520049:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587824768:12345-0@lo:501: 00000100:00100000:3.0:1783966786.520056:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587824640:12345-0@lo:13: 00002000:00000024:3.0:1783966786.520081:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783966786.520122:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587824640:12345-0@lo:13: Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.520129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783966786.520162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4000 x1870624587824640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.520180:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587824640:0@lo:13: 00000004:00080000:3.0:1783966786.520201:0:9987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783966786.520218:0:9987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587824896:0@lo:7: 00000100:00100000:3.0:1783966786.520245:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.520267:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587824896 00000100:00100000:3.0:1783966786.520271:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587824896 00000100:00100000:3.0:1783966786.520307:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783966786.520314:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9987:x1870624587824896:12345-0@lo:7: 00000100:00100000:1.0:1783966786.520635:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587824768:12345-0@lo:501: Request processed in 588us (716us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783966786.520644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783966786.521194:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587824768:0@lo:501: 10000000:01000000:0.0:1783966786.521234:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783966786.521245:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966786.521255:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783966786.521484:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966786.522169:0:9987:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3840 going to sleep for 11 seconds 00000004:00080000:1.0:1783966786.524920:0:9983:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783966786.524955:0:9983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825152:0@lo:7: 00000100:00100000:1.0:1783966786.525020:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.525058:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825152 00000100:00100000:0.0:1783966786.525148:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966786.525161:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587825024:0@lo:13: 00000100:00100000:0.0:1783966786.525196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.525228:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825024 00000100:00100000:0.0:1783966786.525233:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825024 00000100:00100000:0.0:1783966786.525274:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783966786.525283:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587825024:12345-0@lo:13: 00002000:00000024:0.0:1783966786.525302:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1783966786.525354:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587825024:12345-0@lo:13: Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966786.525361:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1783966786.525403:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b1180 x1870624587825024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966786.525437:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587825024:0@lo:13: 00000100:00100000:1.0:1783966786.525587:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825152 00000100:00100000:1.0:1783966786.525640:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783966786.525650:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587825152:12345-0@lo:7: 00000100:00100000:0.0:1783966786.526831:0:9983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea606180 going to sleep for 11 seconds 00002000:00080000:3.0:1783966786.526897:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783966786.526904:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783966786.526968:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9987:x1870624587824896:12345-0@lo:7: Request processed in 6653us (6721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.526976:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783966786.527171:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4000 x1870624587824896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966786.527185:0:9987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587824896:0@lo:7: 00000004:00080000:0.0:1783966786.527198:0:9987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783966786.527230:0:9987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825280:0@lo:5: 00000100:00100000:0.0:1783966786.527262:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966786.527280:0:9987:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47600 going to sleep for 11 seconds 00000100:00100000:2.0:1783966786.527458:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825280 00000100:00100000:2.0:1783966786.527472:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825280 00000100:00100000:2.0:1783966786.527513:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783966786.527520:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9987:x1870624587825280:12345-0@lo:5: 00002000:00080000:2.0:1783966786.527539:0:8714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783966786.527542:0:8714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:2.0:1783966786.529330:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:3.0:1783966786.533502:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1783966786.533518:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783966786.533886:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9987:x1870624587825280:12345-0@lo:5: Request processed in 6362us (6619us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783966786.533897:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783966786.536934:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef208e00 x1870624587825280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.536951:0:9987:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783966786.536959:0:9987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825280:0@lo:5: 00000004:00080000:3.0:1783966786.536978:0:9987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783966786.537041:0:9987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825408:0@lo:700: 00000100:00100000:3.0:1783966786.537117:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.537153:0:9987:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1783966786.537186:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825408 00000100:00100000:2.0:1783966786.537194:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825408 00000100:00100000:2.0:1783966786.537246:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783966786.537254:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9987:x1870624587825408:12345-0@lo:700: 00000100:00100000:2.0:1783966786.541273:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9987:x1870624587825408:12345-0@lo:700: Request processed in 4012us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.541289:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783966786.541467:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4000 x1870624587825408/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.541483:0:9987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825408:0@lo:700: 00000004:02000040:1.0:1783966786.549085:0:9987:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1783966786.564931:0:9987:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825536:0@lo:5: 00000100:00100000:0.0:1783966786.565001:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.566204:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825536 00000100:00100000:3.0:1783966786.566214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825536 00000100:00100000:3.0:1783966786.566274:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783966786.566283:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9987:x1870624587825536:12345-0@lo:5: 00000100:00100000:0.0:1783966786.566457:0:9987:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47600 going to sleep for 11 seconds 00002000:00080000:2.0:1783966786.567300:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783966786.567306:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783966786.569714:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587825152:12345-0@lo:7: Request processed in 44059us (44686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966786.569728:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783966786.571590:0:9983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0380 x1870624587825152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.571621:0:9983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825152:0@lo:7: 00000004:00080000:3.0:1783966786.571636:0:9983:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783966786.571686:0:9983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825664:0@lo:5: 00000100:00100000:3.0:1783966786.571765:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.571819:0:9983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.571911:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825664 00000100:00100000:3.0:1783966786.571918:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825664 00000100:00100000:3.0:1783966786.571960:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966786.571968:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587825664:12345-0@lo:5: 00002000:00080000:3.0:1783966786.571996:0:8714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1783966786.572033:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587825664:12345-0@lo:5: Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.572040:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783966786.572080:0:9983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4000 x1870624587825664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.572090:0:9983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825664:0@lo:5: 00000004:00080000:3.0:1783966786.572097:0:9983:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783966786.572120:0:9983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825792:0@lo:5: 00000100:00100000:3.0:1783966786.572139:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.572153:0:9983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c780 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.572165:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825792 00000100:00100000:3.0:1783966786.572169:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825792 00000100:00100000:3.0:1783966786.572190:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966786.572195:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9983:x1870624587825792:12345-0@lo:5: 00002000:00080000:3.0:1783966786.572218:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1783966786.581169:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9983:x1870624587825792:12345-0@lo:5: Request processed in 8966us (9020us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783966786.581183:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00002000:00080000:0.0:1783966786.581674:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783966786.581700:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00010000:00080000:1.0:1783966786.583509:0:9983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c357a300 x1870624587825792/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.583529:0:9983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9983:1870624587825792:0@lo:5: 00000004:00080000:1.0:1783966786.583544:0:9983:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1783966786.583585:0:9983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9983:1870624587825920:0@lo:900: 00000100:00100000:1.0:1783966786.583640:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966786.583686:0:9983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea606a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966786.584256:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587825920 00000100:00100000:3.0:1783966786.584264:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587825920 00000100:00100000:3.0:1783966786.584313:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783966786.584321:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9983:x1870624587825920:12345-0@lo:900: 00000100:00100000:3.0:1783966786.584402:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9983:x1870624587825920:12345-0@lo:900: Request processed in 80us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.584410:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783966786.585211:0:9983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b3100 x1870624587825920/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966786.585225:0:9983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9983:1870624587825920:0@lo:900: 00000100:00100000:0.0:1783966786.585625:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9987:x1870624587825536:12345-0@lo:5: Request processed in 19341us (20622us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783966786.585634:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783966786.585800:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef208e00 x1870624587825536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783966802 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966786.585813:0:9987:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9987:1870624587825536:0@lo:5: 00000004:00080000:3.0:1783966786.585823:0:9987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1783966786.615167:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783966786.796531:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1783966786.796550:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1783966786.935200:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966786.935227:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587826048:0@lo:41: 00000100:00100000:3.0:1783966786.935293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966786.935367:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826048 00000100:00100000:3.0:1783966786.935375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826048 00000100:00100000:3.0:1783966786.935420:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783966786.935429:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587826048:12345-0@lo:41: 00000004:00000024:3.0:1783966786.935464:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783966786.935510:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587826048:12345-0@lo:41: Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966786.935517:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783966786.935572:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587826048:0@lo:41: 00010000:00010000:3.0:1783966787.638972:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783966787.725011:0:10038:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966787.725253:0:10038:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783966788.664296:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783966788.697569:0:10086:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783966788.697584:0:10086:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1783966789.252691:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.252838:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563658880 00000100:00100000:1.0:1783966789.252854:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563658880 00000100:00100000:1.0:1783966789.252929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:1.0:1783966789.252942:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1870624563658880:12345-192.168.204.59@tcp:250: 00010000:00080000:1.0:1783966789.252988:0:6512:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 5961de9b-00b2-4d50-9cea-eabe4c7514df@192.168.204.59@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1783966789.253033:0:6512:0:(genops.c:1406:class_connect()) connect: client 5961de9b-00b2-4d50-9cea-eabe4c7514df, cookie 0x9269c8b316066dba 00000100:00080000:1.0:1783966789.253232:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9a04c3690000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966789.253332:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+5:2399:x1870624563658880:12345-192.168.204.59@tcp:250: Request processed in 390us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.253340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:0.0:1783966789.257430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.257538:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659008 00000100:00100000:2.0:1783966789.257549:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659008 00000100:00100000:2.0:1783966789.257604:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:2.0:1783966789.257614:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+5:6161:x1870624563659008:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1783966789.257647:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966789.257666:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6aa3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.257719:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.257732:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.257741:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630e00, rc 0) 00000100:00100000:2.0:1783966789.257835:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+6:6161:x1870624563659008:12345-192.168.204.59@tcp:101: Request processed in 222us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.257841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:0.0:1783966789.261896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.262101:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659136 00000100:00100000:2.0:1783966789.262110:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659136 00000100:00100000:2.0:1783966789.262164:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:2.0:1783966789.262174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+6:6161:x1870624563659136:12345-192.168.204.59@tcp:501: 00000100:00100000:2.0:1783966789.262298:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+6:6161:x1870624563659136:12345-192.168.204.59@tcp:501: Request processed in 126us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783966789.262315:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:0.0:1783966789.265948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.266135:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659264 00000100:00100000:2.0:1783966789.266145:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659264 00000100:00100000:2.0:1783966789.266198:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:2.0:1783966789.266208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+6:6161:x1870624563659264:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1783966789.266226:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966789.266245:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6aaa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.266277:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.266316:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966789.266327:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966789.266433:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+7:6161:x1870624563659264:12345-192.168.204.59@tcp:101: Request processed in 225us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.266442:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:0.0:1783966789.276167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.276376:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659392 00000100:00100000:2.0:1783966789.276386:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659392 00000100:00100000:2.0:1783966789.276444:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:2.0:1783966789.276454:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+7:6161:x1870624563659392:12345-192.168.204.59@tcp:501: 00000100:00100000:2.0:1783966789.276844:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6161:x1870624563659392:12345-192.168.204.59@tcp:501: Request processed in 390us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.276854:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:2.0:1783966789.284559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966789.284809:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659520 00000100:00100000:0.0:1783966789.284823:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659520 00000100:00100000:0.0:1783966789.284901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:0.0:1783966789.284932:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6161:x1870624563659520:12345-192.168.204.59@tcp:503: 00000100:00100000:0.0:1783966789.285946:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6161:x1870624563659520:12345-192.168.204.59@tcp:503: Request processed in 1010us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966789.286824:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:1.0:1783966789.292508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.293186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659648 00000100:00100000:2.0:1783966789.293200:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659648 00000100:00100000:2.0:1783966789.293279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:2.0:1783966789.293291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6179:x1870624563659648:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1783966789.293518:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6179:x1870624563659648:12345-192.168.204.59@tcp:502: Request processed in 228us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.293527:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:1.0:1783966789.353743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966789.355075:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659776 00000100:00100000:0.0:1783966789.355088:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659776 00000100:00100000:0.0:1783966789.355153:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:0.0:1783966789.355164:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6179:x1870624563659776:12345-192.168.204.59@tcp:502: 00000100:00100000:0.0:1783966789.355404:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6179:x1870624563659776:12345-192.168.204.59@tcp:502: Request processed in 241us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966789.355413:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:3.0:1783966789.362674:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.363013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563659904 00000100:00100000:1.0:1783966789.363024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563659904 00000100:00100000:1.0:1783966789.363140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:1.0:1783966789.363156:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6161:x1870624563659904:12345-192.168.204.59@tcp:101: 00010000:00010000:1.0:1783966789.363174:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966789.363194:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62c00/0x9269c8b316066dcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6adb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.363220:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62c00/0x9269c8b316066dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6adb expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.363228:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62c00/0x9269c8b316066dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6adb expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.363235:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62c00, rc 0) 00000100:00100000:1.0:1783966789.363368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6161:x1870624563659904:12345-192.168.204.59@tcp:101: Request processed in 215us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.363373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:1.0:1783966789.366543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966789.366604:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660032 00000100:00100000:0.0:1783966789.366614:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660032 00000100:00100000:0.0:1783966789.366907:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:0.0:1783966789.366920:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6161:x1870624563660032:12345-192.168.204.59@tcp:256: 20000000:01000000:0.0:1783966789.366948:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783966789.366973:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783966789.366977:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783966789.366981:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783966789.366984:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783966789.366986:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1783966789.371370:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6161:x1870624563660032:12345-192.168.204.59@tcp:256: Request processed in 4441us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.371385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:3.0:1783966789.377350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.377446:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660160 00000100:00100000:1.0:1783966789.377456:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660160 00000100:00100000:1.0:1783966789.377511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:1.0:1783966789.377532:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6161:x1870624563660160:12345-192.168.204.59@tcp:101: 00010000:00010000:1.0:1783966789.377549:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966789.377569:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ae2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.377597:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.377609:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966789.377618:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63c00, rc 0) 00000100:00100000:1.0:1783966789.377681:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6161:x1870624563660160:12345-192.168.204.59@tcp:101: Request processed in 152us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.377688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:1.0:1783966789.380029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.380269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660288 00000100:00100000:2.0:1783966789.380279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660288 00000100:00100000:2.0:1783966789.380336:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:2.0:1783966789.380344:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6161:x1870624563660288:12345-192.168.204.59@tcp:501: 00000100:00100000:2.0:1783966789.381001:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6161:x1870624563660288:12345-192.168.204.59@tcp:501: Request processed in 654us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.381010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:0.0:1783966789.388595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.389871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660416 00000100:00100000:1.0:1783966789.389884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660416 00000100:00100000:1.0:1783966789.390003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:1.0:1783966789.390016:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6161:x1870624563660416:12345-192.168.204.59@tcp:503: 00000100:00100000:1.0:1783966789.390190:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6161:x1870624563660416:12345-192.168.204.59@tcp:503: Request processed in 176us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.390205:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:3.0:1783966789.395716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.395915:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660544 00000100:00100000:2.0:1783966789.395925:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660544 00000100:00100000:2.0:1783966789.395985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:2.0:1783966789.395994:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6183:x1870624563660544:12345-192.168.204.59@tcp:502: 00000100:00100000:2.0:1783966789.396186:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6183:x1870624563660544:12345-192.168.204.59@tcp:502: Request processed in 192us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.396194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:2.0:1783966789.398860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966789.398958:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660672 00000100:00100000:3.0:1783966789.398968:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660672 00000100:00100000:3.0:1783966789.399127:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:3.0:1783966789.399137:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6183:x1870624563660672:12345-192.168.204.59@tcp:502: 00000100:00100000:3.0:1783966789.399327:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6183:x1870624563660672:12345-192.168.204.59@tcp:502: Request processed in 192us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966789.399334:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:1.0:1783966789.407743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.407821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.407913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660800 00000100:00100000:2.0:1783966789.407922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660800 00000100:00100000:2.0:1783966789.407972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661056 00000100:00100000:2.0:1783966789.407975:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661056 00000100:00100000:2.0:1783966789.407993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783966789.408000:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1870624563660800:12345-192.168.204.59@tcp:38: 00010000:00080000:2.0:1783966789.408029:0:6518:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1783966789.408078:0:6518:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316066ddd 00000004:00100000:2.0:1783966789.408102:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1783966789.408318:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783966789.408382:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563660800:12345-192.168.204.59@tcp:38: Request processed in 380us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.408405:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783966789.408423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1783966789.408427:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1870624563661056:12345-192.168.204.59@tcp:38: 00010000:00080000:2.0:1783966789.408441:0:6518:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1783966789.408467:0:6518:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316066de4 00000004:00100000:2.0:1783966789.408478:0:6518:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1783966789.408600:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783966789.408627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563661056:12345-192.168.204.59@tcp:38: Request processed in 197us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966789.408633:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00010000:00010000:0.0:1783966789.687312:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966789.916339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966789.916380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.916887:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563660928 00000100:00100000:1.0:1783966789.916898:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563660928 00000100:00100000:1.0:1783966789.916971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661312 00000100:00100000:1.0:1783966789.916974:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661312 00000100:00100000:1.0:1783966789.916997:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783966789.917019:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:0:x1870624563660928:12345-192.168.204.59@tcp:41: 00000100:00080000:3.0:1783966789.917027:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966789.917048:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1783966789.917058:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:6161:x1870624563661312:12345-192.168.204.59@tcp:41: 00000004:00000024:1.0:1783966789.917076:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:3.0:1783966789.917077:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783966789.917150:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:0:x1870624563660928:12345-192.168.204.59@tcp:41: Request processed in 133us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.917158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1783966789.920360:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563661312:12345-192.168.204.59@tcp:41: Request processed in 3293us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966789.920437:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1783966789.926135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.926528:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661184 00000100:00100000:1.0:1783966789.926539:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661184 00000100:00100000:1.0:1783966789.926682:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1783966789.926694:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:0:x1870624563661184:12345-192.168.204.59@tcp:41: 00000004:00000024:1.0:1783966789.926742:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966789.926840:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:0:x1870624563661184:12345-192.168.204.59@tcp:41: Request processed in 149us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.926848:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00080000:3.0:1783966789.926923:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966789.933145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.933835:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661440 00000100:00100000:1.0:1783966789.933850:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661440 00000100:00100000:1.0:1783966789.933931:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1783966789.933943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563661440:12345-192.168.204.59@tcp:40: 00000100:00100000:1.0:1783966789.934912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563661440:12345-192.168.204.59@tcp:40: Request processed in 965us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.934942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1783966789.939205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966789.939330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966789.939436:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661824 00000100:00100000:3.0:1783966789.939449:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661824 00000100:00100000:3.0:1783966789.939528:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:3.0:1783966789.939539:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563661824:12345-192.168.204.59@tcp:400: 00000100:00100000:3.0:1783966789.939932:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563661824:12345-192.168.204.59@tcp:400: Request processed in 392us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966789.940033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:1.0:1783966789.940137:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661568 00000100:00100000:1.0:1783966789.940143:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661568 00000100:00100000:1.0:1783966789.940182:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1783966789.940188:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563661568:12345-192.168.204.59@tcp:8: 00010000:00080000:1.0:1783966789.940223:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:1.0:1783966789.940282:0:8434:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316066deb 00002000:00100000:1.0:1783966789.940299:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4272c10e-7366-407e-b067-e3d2ea5c5b05/ffff9a04c3696000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783966789.940323:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1783966789.942578:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783966789.942656:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a04c3695800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966789.959188:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563661568:12345-192.168.204.59@tcp:8: Request processed in 18976us (19977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.959209:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783966789.965540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966789.967101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966789.967293:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661952 00000100:00100000:1.0:1783966789.967307:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661952 00000100:00100000:1.0:1783966789.967384:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1783966789.967396:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563661952:12345-192.168.204.59@tcp:900: 00000100:00100000:1.0:1783966789.967529:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563661952:12345-192.168.204.59@tcp:900: Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966789.967538:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1783966789.970616:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563661696 00000100:00100000:3.0:1783966789.970825:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563661696 00000100:00100000:0.0:1783966789.974504:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1783966789.974522:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1870624563661696:12345-192.168.204.59@tcp:8: 00010000:00080000:0.0:1783966789.974573:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1783966789.974816:0:8433:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316066df2 00002000:00100000:0.0:1783966789.974833:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4272c10e-7366-407e-b067-e3d2ea5c5b05/ffff9a05fcf77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783966789.974857:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783966789.975084:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783966789.975129:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf71800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783966789.975311:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563661696:12345-192.168.204.59@tcp:8: Request processed in 789us (9785us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966789.975324:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1783966789.977357:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966789.979387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662080 00000100:00100000:3.0:1783966789.979408:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662080 00000100:00100000:3.0:1783966789.979502:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1783966789.979525:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563662080:12345-192.168.204.59@tcp:33: 00000100:00100000:0.0:1783966790.007035:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966790.007062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587826176:0@lo:41: 00000100:00100000:0.0:1783966790.007132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966790.007200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826176 00000100:00100000:0.0:1783966790.007207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826176 00000100:00100000:0.0:1783966790.007727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783966790.007739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587826176:12345-0@lo:41: 00000004:00000024:0.0:1783966790.007786:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966790.007900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587826176:12345-0@lo:41: Request processed in 163us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966790.007929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587826176:0@lo:41: 00000100:00100000:0.0:1783966790.007976:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1783966790.008100:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28063us 00000004:00200000:1.0:1783966790.025709:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783966790.025834:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6161:x1870624563662080:12345-192.168.204.59@tcp:33: Request processed in 46306us (48485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966790.025854:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783966790.319416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966790.323145:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662208 00000100:00100000:2.0:1783966790.323159:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662208 00000100:00100000:2.0:1783966790.323242:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1783966790.323252:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6201:x1870624563662208:12345-192.168.204.59@tcp:101: 00010000:00010000:2.0:1783966790.323282:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966790.323365:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316066df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b13 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323554:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323570:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323602:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966790.323664:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966790.323668:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966790.323684:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323709:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316066df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b13 expref: 8 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323729:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b13 expref: 7 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966790.323737:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc8200) 00010000:00010000:2.0:1783966790.323739:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966790.323742:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:2.0:1783966790.324048:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:6201:x1870624563662208:12345-192.168.204.59@tcp:101: Request processed in 796us (4639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966790.324055:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:3.0:1783966790.713394:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966791.542971:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587826432:0@lo:13: 00000100:00100000:2.0:1783966791.543033:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587826560:0@lo:400: 00000100:00100000:3.0:1783966791.543052:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966791.543077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966791.543203:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587826304:0@lo:400: 00000100:00100000:0.0:1783966791.543251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543308:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587826944:0@lo:400: 00000100:00100000:3.0:1783966791.543335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543357:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587827456:0@lo:400: 00000100:00100000:3.0:1783966791.543382:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543404:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587827968:0@lo:400: 00000100:00100000:3.0:1783966791.543432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543460:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587826688:0@lo:400: 00000100:00100000:3.0:1783966791.543483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543500:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587827200:0@lo:400: 00000100:00100000:3.0:1783966791.543520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543536:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587827712:0@lo:400: 00000100:00100000:3.0:1783966791.543559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543578:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966791.543591:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587828096:0@lo:13: 00000100:00100000:3.0:1783966791.543624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.543654:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826432 00000100:00100000:3.0:1783966791.543661:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826432 00000100:00100000:3.0:1783966791.543704:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828096 00000100:00100000:3.0:1783966791.543707:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828096 00000100:00100000:3.0:1783966791.543723:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966791.543731:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587826432:12345-0@lo:13: 00002000:00000024:3.0:1783966791.543756:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966791.543818:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587826432:12345-0@lo:13: Request processed in 87us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.543826:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783966791.543844:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966791.543850:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587828096:12345-0@lo:13: 00002000:00000024:3.0:1783966791.543860:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966791.543889:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587828096:12345-0@lo:13: Request processed in 39us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.543895:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783966791.543913:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826944 00000100:00100000:3.0:1783966791.543916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826944 00000100:00100000:3.0:1783966791.543933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826688 00000100:00100000:3.0:1783966791.543935:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826688 00000100:00100000:3.0:1783966791.543946:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783966791.543951:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587826944:12345-0@lo:400: 00000100:00100000:3.0:1783966791.543983:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587826944:12345-0@lo:400: Request processed in 31us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.543989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783966791.544001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783966791.544013:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587826688:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544041:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587826688:12345-0@lo:400: Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783966791.544065:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827456 00000100:00100000:3.0:1783966791.544068:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827456 00000100:00100000:3.0:1783966791.544092:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827968 00000100:00100000:3.0:1783966791.544095:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827968 00000100:00100000:3.0:1783966791.544112:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783966791.544118:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587827456:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544147:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587827456:12345-0@lo:400: Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544153:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783966791.544165:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783966791.544171:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587827968:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544197:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587827968:12345-0@lo:400: Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544202:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783966791.544220:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966791.544223:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966791.544231:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826560 00000100:00100000:3.0:1783966791.544235:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826560 00000100:00100000:3.0:1783966791.544256:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827200 00000100:00100000:3.0:1783966791.544259:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827200 00000100:00100000:3.0:1783966791.544273:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827712 00000100:00100000:3.0:1783966791.544276:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827712 00000100:00100000:3.0:1783966791.544289:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783966791.544294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587826560:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544323:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587826560:12345-0@lo:400: Request processed in 29us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783966791.544347:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783966791.544353:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587827200:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544381:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587827200:12345-0@lo:400: Request processed in 29us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544387:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783966791.544398:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783966791.544403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587827712:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587827712:12345-0@lo:400: Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544431:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1783966791.544444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783966791.544471:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05cf067b80 x1870624587828096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544491:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587828096:0@lo:13: 00000100:00100000:3.0:1783966791.544502:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587826688:0@lo:400: 00010000:00080000:3.0:1783966791.544512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3728000 x1870624587827200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544519:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587827200:0@lo:400: 00010000:00080000:3.0:1783966791.544528:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3728a80 x1870624587827712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544534:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587827712:0@lo:400: 00000100:00100000:3.0:1783966791.544570:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587826944:0@lo:400: 00010000:00080000:3.0:1783966791.544589:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729c00 x1870624587827456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544610:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587827456:0@lo:400: 00010000:00080000:3.0:1783966791.544622:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372aa00 x1870624587827968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544629:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1783966791.544641:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587827968:0@lo:400: 00010000:00080000:3.0:1783966791.544649:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3578000 x1870624587826432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.544659:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587826432:0@lo:13: 00000100:00100000:3.0:1783966791.544705:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826304 00000100:00100000:3.0:1783966791.544709:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826304 00000100:00100000:3.0:1783966791.544735:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783966791.544741:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587826304:12345-0@lo:400: 00000100:00100000:3.0:1783966791.544796:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587826304:12345-0@lo:400: Request processed in 55us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.544802:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783966791.544996:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966791.545006:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587828352:0@lo:13: 00000100:00100000:1.0:1783966791.545038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966791.545072:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828352 00000100:00100000:1.0:1783966791.545076:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828352 00000100:00100000:1.0:1783966791.545107:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783966791.545113:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587828352:12345-0@lo:13: 00002000:00000024:1.0:1783966791.545124:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966791.545157:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587828352:12345-0@lo:13: Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966791.545163:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1783966791.545179:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783966791.545197:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b2a00 x1870624587828352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966791.545205:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783966791.545218:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587828352:0@lo:13: 00000100:00100000:2.0:1783966791.546521:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587826560:0@lo:400: 00000100:00100000:2.0:1783966791.546536:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587827072:0@lo:400: 00000100:00100000:2.0:1783966791.546591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966791.546697:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587827584:0@lo:400: 00000100:00100000:2.0:1783966791.546741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.547669:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828224:0@lo:13: 00000100:00100000:3.0:1783966791.547729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966791.548352:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828224 00000100:00100000:3.0:1783966791.548363:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828224 00000100:00100000:3.0:1783966791.548418:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783966791.548426:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828224:12345-0@lo:13: 00002000:00000024:3.0:1783966791.548453:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966791.548504:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828224:12345-0@lo:13: Request processed in 79us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966791.548523:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783966791.548562:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b1f80 x1870624587828224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966791.548581:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828224:0@lo:13: 00000100:00100000:0.0:1783966791.549144:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587826304:0@lo:400: 00000100:00100000:0.0:1783966791.549159:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587826816:0@lo:400: 00000100:00100000:0.0:1783966791.549205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966791.549321:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827072 00000100:00100000:1.0:1783966791.550279:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827072 00000100:00100000:1.0:1783966791.550508:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827584 00000100:00100000:1.0:1783966791.550514:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827584 00000100:00100000:1.0:1783966791.550548:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783966791.550557:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587827072:12345-0@lo:400: 00000100:00100000:1.0:1783966791.550646:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587827072:12345-0@lo:400: Request processed in 91us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966791.550654:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783966791.550681:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783966791.550687:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587827584:12345-0@lo:400: 00000100:00100000:1.0:1783966791.550716:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587827584:12345-0@lo:400: Request processed in 29us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966791.550722:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783966791.551290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966791.551498:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587827072:0@lo:400: 00000100:00100000:3.0:1783966791.551514:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587827584:0@lo:400: 00000100:00100000:0.0:1783966791.551805:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587827328:0@lo:400: 00000100:00100000:0.0:1783966791.551858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966791.551885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587827840:0@lo:400: 00000100:00100000:0.0:1783966791.551930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966791.551962:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827328 00000100:00100000:0.0:1783966791.551968:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827328 00000100:00100000:0.0:1783966791.552003:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587827840 00000100:00100000:0.0:1783966791.552006:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587827840 00000100:00100000:0.0:1783966791.552024:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783966791.552031:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587827328:12345-0@lo:400: 00000100:00100000:0.0:1783966791.552070:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587827328:12345-0@lo:400: Request processed in 39us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966791.552077:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783966791.552090:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783966791.552096:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587827840:12345-0@lo:400: 00000100:00100000:0.0:1783966791.552122:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587827840:12345-0@lo:400: Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966791.552127:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783966791.552196:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729500 x1870624587827840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966791.552208:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587827840:0@lo:400: 00010000:00080000:0.0:1783966791.552247:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729880 x1870624587827328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966791.552256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587827328:0@lo:400: 00000100:00100000:1.0:1783966791.554626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587826816 00000100:00100000:1.0:1783966791.554640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587826816 00000100:00100000:1.0:1783966791.554713:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783966791.554723:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587826816:12345-0@lo:400: 00000100:00100000:1.0:1783966791.554869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587826816:12345-0@lo:400: Request processed in 147us (5662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966791.554876:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783966791.555232:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587826816:0@lo:400: 00010000:00010000:2.0:1783966791.734923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966792.055061:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966792.055085:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587828480:0@lo:41: 00000100:00100000:0.0:1783966792.055155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966792.055268:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828480 00000100:00100000:3.0:1783966792.055277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828480 00000100:00100000:3.0:1783966792.055330:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783966792.055339:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587828480:12345-0@lo:41: 00000004:00000024:3.0:1783966792.055374:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783966792.055431:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587828480:12345-0@lo:41: Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966792.055438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783966792.055580:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587828480:0@lo:41: 00000100:00100000:1.0:1783966792.448636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966792.448880:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662336 00000100:00100000:2.0:1783966792.448890:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662336 00000100:00100000:2.0:1783966792.448966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1783966792.448975:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:6253:x1870624563662336:12345-192.168.204.59@tcp:41: 00000004:00000024:2.0:1783966792.449005:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783966792.449074:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:6253:x1870624563662336:12345-192.168.204.59@tcp:41: Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966792.449082:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:3.0:1783966792.449146:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966792.461995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966792.462149:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662464 00000100:00100000:1.0:1783966792.462158:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662464 00000100:00100000:1.0:1783966792.462231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1783966792.462241:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662464:12345-192.168.204.59@tcp:41: 00000004:00000024:1.0:1783966792.462278:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966792.462356:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662464:12345-192.168.204.59@tcp:41: Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966792.462363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:3.0:1783966792.466002:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966792.468990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966792.469095:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662592 00000100:00100000:3.0:1783966792.469109:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662592 00000100:00100000:3.0:1783966792.469219:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966792.469234:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662592:12345-192.168.204.59@tcp:13: 00002000:00000024:3.0:1783966792.469291:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966792.469380:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662592:12345-192.168.204.59@tcp:13: Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966792.469410:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00080000:1.0:1783966792.471257:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966792.474524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966792.475027:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662720 00000100:00100000:3.0:1783966792.475040:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662720 00000100:00100000:3.0:1783966792.475132:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:3.0:1783966792.475144:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662720:12345-192.168.204.59@tcp:13: 00002000:00000024:3.0:1783966792.475186:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966792.475283:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:6253:x1870624563662720:12345-192.168.204.59@tcp:13: Request processed in 141us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966792.475290:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00080000:1.0:1783966792.477508:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783966792.759186:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966793.791368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783966794.620115:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000001:00100000:1.0:1783966794.620695:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000001:00100000:3.0:1783966794.623631:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00010000:00010000:2.0:1783966794.807052:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966795.017428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966795.017481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966795.017648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966795.017687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966795.017760:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663360 00000100:00100000:1.0:1783966795.017791:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663360 00000100:00100000:1.0:1783966795.017878:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1783966795.017891:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563663360:12345-192.168.204.59@tcp:400: 00000100:00100000:1.0:1783966795.018008:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563663360:12345-192.168.204.59@tcp:400: Request processed in 120us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966795.018017:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00080000:1.0:1783966795.018046:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966795.018887:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662848 00000100:00100000:3.0:1783966795.018898:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662848 00000100:00100000:3.0:1783966795.018961:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:3.0:1783966795.018969:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2403:x1870624563662848:12345-192.168.204.59@tcp:400: 00000100:00100000:3.0:1783966795.019030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2403:x1870624563662848:12345-192.168.204.59@tcp:400: Request processed in 62us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966795.019038:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:0.0:1783966795.021600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966795.021852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663104 00000100:00100000:2.0:1783966795.021865:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663104 00000100:00100000:3.0:1783966795.021883:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663232 00000100:00100000:3.0:1783966795.021890:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663232 00000100:00100000:2.0:1783966795.021955:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563662976 00000100:00100000:2.0:1783966795.021960:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563662976 00000100:00100000:3.0:1783966795.021965:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783966795.021978:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563663232:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1783966795.021995:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1783966795.022006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563663104:12345-192.168.204.59@tcp:400: 00000100:00100000:3.0:1783966795.022074:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563663232:12345-192.168.204.59@tcp:400: Request processed in 98us (488us total) trans 0 rc 0/0 00000100:00080000:0.0:1783966795.022076:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966795.022083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966795.022086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966795.022106:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:1.0:1783966795.022825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783966795.022839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563662976:12345-192.168.204.59@tcp:400: 00000100:00100000:2.0:1783966795.022983:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563663104:12345-192.168.204.59@tcp:400: Request processed in 978us (5499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966795.022992:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1783966795.023081:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563662976:12345-192.168.204.59@tcp:400: Request processed in 246us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966795.023090:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783966795.130376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966795.130416:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828608:0@lo:41: 00000100:00100000:0.0:1783966795.130518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966795.130610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828608 00000100:00100000:0.0:1783966795.130620:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828608 00000100:00100000:0.0:1783966795.130684:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966795.130696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828608:12345-0@lo:41: 00000004:00000024:0.0:1783966795.130752:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966795.130843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828608:12345-0@lo:41: Request processed in 149us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966795.130850:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966795.130903:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828608:0@lo:41: 00000001:00100000:3.0:1783966795.644273:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000001:02000400:2.0:1783966795.672296:0:10184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783966795.831037:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966796.663046:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828736:0@lo:13: 00000100:00100000:3.0:1783966796.663154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966796.663274:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828736 00000100:00100000:3.0:1783966796.663283:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828736 00000100:00100000:3.0:1783966796.663356:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783966796.663369:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828736:12345-0@lo:13: 00002000:00000024:3.0:1783966796.663406:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966796.663457:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587828736:12345-0@lo:13: Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.663466:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1783966796.663488:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783966796.663537:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c357ad80 x1870624587828736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966796.663560:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587828736:0@lo:13: 00000100:00100000:0.0:1783966796.663860:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587828864:0@lo:13: 00000100:00100000:0.0:1783966796.663898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966796.664007:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828864 00000100:00100000:3.0:1783966796.664012:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828864 00000100:00100000:3.0:1783966796.664052:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783966796.664060:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587828864:12345-0@lo:13: 00002000:00000024:3.0:1783966796.664080:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966796.664113:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587828864:12345-0@lo:13: Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.664120:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783966796.664417:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587828992:0@lo:13: 00000100:00100000:0.0:1783966796.664449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783966796.664492:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783966796.664522:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f63ded80 x1870624587828864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966796.664537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587828864:0@lo:13: 00000100:00100000:1.0:1783966796.664596:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587828992 00000100:00100000:1.0:1783966796.664602:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587828992 00000100:00100000:1.0:1783966796.664641:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783966796.664653:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587828992:12345-0@lo:13: 00002000:00000024:1.0:1783966796.664665:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966796.664701:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587828992:12345-0@lo:13: Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966796.664708:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783966796.665391:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966796.665405:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587829120:0@lo:13: 00000100:00100000:3.0:1783966796.665461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966796.665514:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829120 00000100:00100000:3.0:1783966796.665519:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829120 00000100:00100000:3.0:1783966796.665556:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783966796.665564:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587829120:12345-0@lo:13: 00002000:00000024:3.0:1783966796.665579:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966796.665614:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587829120:12345-0@lo:13: Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.665621:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783966796.665652:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c357ad80 x1870624587829120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966796.665957:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587829120:0@lo:13: 00000100:00100000:3.0:1783966796.666643:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587829248:0@lo:400: 00000100:00100000:3.0:1783966796.666700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966796.666729:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829248 00000100:00100000:1.0:1783966796.666735:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829248 00000100:00100000:3.0:1783966796.666736:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587829760:0@lo:400: 00000100:00100000:3.0:1783966796.666761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966796.666794:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783966796.666795:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587830272:0@lo:400: 00000100:00100000:1.0:1783966796.666802:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587829248:12345-0@lo:400: 00000100:00100000:3.0:1783966796.666818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966796.666835:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783966796.666841:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587829632:0@lo:400: 00000100:00100000:1.0:1783966796.666845:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587829248:12345-0@lo:400: Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966796.666852:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783966796.666936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966796.666946:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829760 00000100:00100000:0.0:1783966796.666950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829760 00000100:00100000:3.0:1783966796.666964:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587830144:0@lo:400: 00000100:00100000:0.0:1783966796.666983:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783966796.666987:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966796.666989:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587829760:12345-0@lo:400: 00000100:00100000:3.0:1783966796.667011:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587829248:0@lo:400: 00000100:00100000:0.0:1783966796.667027:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587829760:12345-0@lo:400: Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.667031:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587829760:0@lo:400: 00000100:00100000:0.0:1783966796.667033:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1783966796.667054:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966796.667059:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966796.667062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830272 00000100:00100000:3.0:1783966796.667066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830272 00000100:00100000:0.0:1783966796.667071:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587829504:0@lo:400: 00000100:00100000:0.0:1783966796.667097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966796.667101:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829632 00000100:00100000:3.0:1783966796.667104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829632 00000100:00100000:0.0:1783966796.667112:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587830016:0@lo:400: 00000100:00100000:3.0:1783966796.667116:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830144 00000100:00100000:3.0:1783966796.667118:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830144 00000100:00100000:0.0:1783966796.667145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966796.667189:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b1180 x1870624587828992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966796.667204:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587828992:0@lo:13: 00000100:00100000:0.0:1783966796.667217:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783966796.667222:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587829376:0@lo:400: 00000100:00100000:0.0:1783966796.667244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966796.667255:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587829888:0@lo:400: 00000100:00100000:0.0:1783966796.667272:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783966796.667288:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966796.667292:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966796.667300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829504 00000100:00100000:0.0:1783966796.667303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829504 00000100:00100000:0.0:1783966796.667325:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783966796.667330:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587829504:12345-0@lo:400: 00000100:00100000:0.0:1783966796.667361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587829504:12345-0@lo:400: Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966796.667367:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783966796.667394:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587829504:0@lo:400: 00000100:00100000:3.0:1783966796.667429:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830016 00000100:00100000:0.0:1783966796.667430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829376 00000100:00100000:3.0:1783966796.667433:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830016 00000100:00100000:0.0:1783966796.667433:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829376 00000100:00100000:0.0:1783966796.667447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587829888 00000100:00100000:0.0:1783966796.667449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587829888 00000100:00100000:3.0:1783966796.667452:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783966796.667458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587830272:12345-0@lo:400: 00000100:00100000:0.0:1783966796.667461:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783966796.667466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587829632:12345-0@lo:400: 00000100:00100000:3.0:1783966796.667493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587830272:12345-0@lo:400: Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.667510:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783966796.667522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783966796.667528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587830144:12345-0@lo:400: 00000100:00100000:1.0:1783966796.667533:0:7847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783966796.667541:0:7847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1783966796.667714:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783966796.667722:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587829376:12345-0@lo:400: 00000100:00100000:1.0:1783966796.667760:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587829376:12345-0@lo:400: Request processed in 38us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966796.667766:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783966796.667804:0:7847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783966796.667811:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783966796.667816:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587830016:12345-0@lo:400: 00000100:00100000:1.0:1783966796.667842:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587830016:12345-0@lo:400: Request processed in 26us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966796.667848:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783966796.667858:0:7847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1783966796.667864:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783966796.667869:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587829888:12345-0@lo:400: 00000100:00100000:1.0:1783966796.667894:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587829888:12345-0@lo:400: Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966796.667900:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1783966796.668845:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966796.668853:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966796.668926:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587829632:12345-0@lo:400: Request processed in 1455us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966796.668935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783966796.669002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587829376:0@lo:400: 00000100:00100000:0.0:1783966796.669014:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587829888:0@lo:400: 00010000:00080000:0.0:1783966796.669027:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5ad80 x1870624587830016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966796.669037:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587830016:0@lo:400: 00000100:00100000:3.0:1783966796.669731:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587830144:12345-0@lo:400: Request processed in 2200us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966796.669741:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783966796.669891:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587829632:0@lo:400: 00000100:00100000:3.0:1783966796.669906:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587830144:0@lo:400: 00010000:00080000:3.0:1783966796.669921:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5b480 x1870624587830272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966796.669931:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587830272:0@lo:400: 00010000:00010000:0.0:1783966796.868118:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966797.175399:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587830400:0@lo:41: 00000100:00100000:0.0:1783966797.175513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966797.175662:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830400 00000100:00100000:3.0:1783966797.175673:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830400 00000100:00100000:3.0:1783966797.175736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783966797.175748:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587830400:12345-0@lo:41: 00000004:00000024:3.0:1783966797.175826:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1783966797.175886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587830400:12345-0@lo:41: Request processed in 140us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966797.175895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783966797.175948:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587830400:0@lo:41: 00010000:00010000:2.0:1783966797.880196:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966798.903741:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783966799.814473:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9932ead0 20000000:00000080:2.0:1783966799.814494:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05ef0d0800 uarg=0000000000000000 20000000:01000000:2.0:1783966799.814547:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783966799.814550:0:10332:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783966799.814554:0:10332:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783966799.814558:0:10332:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783966799.814568:0:10332:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783966799.814637:0:10332:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783966799.814640:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783966799.815302:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1783966799.815546:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1783966799.815576:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1783966799.815591:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1783966799.815603:0:10332:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783966799.815605:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783966799.816420:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1783966799.816618:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1783966799.816642:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1783966799.816656:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1783966799.816666:0:10332:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783966799.816667:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783966799.817564:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1783966799.818286:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1783966799.818315:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1783966799.818332:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1783966799.818344:0:10332:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783966799.818347:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783966799.819189:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1783966799.819385:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1783966799.819407:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1783966799.819487:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1783966799.819500:0:10332:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783966799.819502:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783966799.819750:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1783966799.820202:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1783966799.820226:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1783966799.820244:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1783966799.820260:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783966799.820283:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820302:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066c9b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820311:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820332:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d04 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820339:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d12 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820347:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d20 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820354:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d3c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820362:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d5f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820369:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066d82 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820378:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066dac expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820388:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820396:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820404:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820467:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820483:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820498:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830528:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966799.820653:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820663:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820672:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830656:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966799.820708:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820716:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 23 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820724:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830784:0@lo:104: 00000100:00100000:0.0:1783966799.820767:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966799.820832:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820840:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820858:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830912:0@lo:104: 00000100:00100000:0.0:1783966799.820878:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966799.820912:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820920:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 23 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820928:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831040:0@lo:104: 00000100:00100000:0.0:1783966799.820954:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966799.820972:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.820979:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 23 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.820987:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831168:0@lo:104: 00000100:00100000:0.0:1783966799.821003:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966799.821014:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.821021:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 23 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.821028:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831296:0@lo:104: 00010000:00010000:0.0:1783966799.821044:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.821060:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.821068:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831424:0@lo:104: 00010000:00010000:0.0:1783966799.821087:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.821094:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.821210:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831552:0@lo:104: 00010000:00010000:0.0:1783966799.821235:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.821242:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.821250:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831680:0@lo:104: 00010000:00010000:0.0:1783966799.821266:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.821273:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.821280:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831808:0@lo:104: 00000100:00100000:0.0:1783966799.821291:0:10332:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e12c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783966799.821365:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783966799.821381:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.821392:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.821400:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.821407:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.821414:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.821421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830784 00000100:00100000:2.0:1783966799.821427:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830784 00000100:00100000:2.0:1783966799.821468:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587830912 00000100:00100000:2.0:1783966799.821471:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587830912 00000100:00100000:2.0:1783966799.821481:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831040 00000100:00100000:2.0:1783966799.821483:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831040 00000100:00100000:2.0:1783966799.821490:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831168 00000100:00100000:2.0:1783966799.821492:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831168 00000100:00100000:2.0:1783966799.821507:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831296 00000100:00100000:2.0:1783966799.821509:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831296 00000100:00100000:2.0:1783966799.821515:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831424 00000100:00100000:2.0:1783966799.821517:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831424 00000100:00100000:2.0:1783966799.821523:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831552 00000100:00100000:2.0:1783966799.821525:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831552 00000100:00100000:2.0:1783966799.821531:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831680 00000100:00100000:2.0:1783966799.821533:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831680 00000100:00100000:2.0:1783966799.821540:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831808 00000100:00100000:2.0:1783966799.821542:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831808 00000100:00100000:2.0:1783966799.821553:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966799.821560:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+11:10332:x1870624587830784:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821572:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821629:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783966799.821635:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+11:10332:x1870624587830784:12345-0@lo:104: Request processed in 75us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821642:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966799.821657:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966799.821662:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+10:10332:x1870624587830912:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821668:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821693:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783966799.821698:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+10:10332:x1870624587830912:12345-0@lo:104: Request processed in 37us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821703:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966799.821712:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966799.821716:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+9:10332:x1870624587831040:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821728:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821762:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783966799.821785:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+9:10332:x1870624587831040:12345-0@lo:104: Request processed in 51us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821792:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966799.821803:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966799.821808:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f55fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+8:10332:x1870624587831168:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821815:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821837:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783966799.821841:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f55fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+8:10332:x1870624587831168:12345-0@lo:104: Request processed in 34us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821847:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966799.821872:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783966799.821877:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+7:10332:x1870624587831296:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821883:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821912:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1783966799.821917:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+7:10332:x1870624587831296:12345-0@lo:104: Request processed in 40us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821922:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783966799.821931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783966799.821935:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+6:10332:x1870624587831424:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821947:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.821968:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1783966799.821973:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+6:10332:x1870624587831424:12345-0@lo:104: Request processed in 37us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.821978:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783966799.821987:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783966799.821992:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:10332:x1870624587831552:12345-0@lo:104: 00010000:00010000:2.0:1783966799.821998:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822015:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1783966799.822019:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:10332:x1870624587831552:12345-0@lo:104: Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.822024:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783966799.822032:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783966799.822037:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:10332:x1870624587831680:12345-0@lo:104: 00010000:00010000:2.0:1783966799.822042:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822059:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1783966799.822064:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:10332:x1870624587831680:12345-0@lo:104: Request processed in 28us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.822070:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783966799.822078:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783966799.822082:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:10332:x1870624587831808:12345-0@lo:104: 00010000:00010000:2.0:1783966799.822093:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822125:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1783966799.822130:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:10332:x1870624587831808:12345-0@lo:104: Request processed in 47us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.822135:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1783966799.822155:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1783966799.822162:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822170:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822174:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822183:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822191:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822197:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822223:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822229:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822246:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822254:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316066dac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066db3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822272:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1783966799.822275:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822280:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c1537e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822283:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822290:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822296:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822300:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822311:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822316:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822326:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822333:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1537e00/0x9269c8b316066d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d89 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822342:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1783966799.822345:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822358:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822361:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822368:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822373:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822378:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822388:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822392:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822397:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822402:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066d5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d66 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822410:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1783966799.822413:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822418:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822421:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822436:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822453:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822459:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822471:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822477:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822482:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822488:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1a00/0x9269c8b316066d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d43 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822497:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783966799.822499:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822505:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822508:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822515:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822521:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822530:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822540:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822545:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822549:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822555:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b316066d20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822563:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783966799.822566:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822571:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822574:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822580:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822586:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822592:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822599:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822604:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822610:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822617:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0030000/0x9269c8b316066d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822625:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783966799.822628:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822633:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822636:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822643:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822649:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822653:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822662:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822666:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822669:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822675:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0030800/0x9269c8b316066d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066d0b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822682:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783966799.822688:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822695:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822698:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822704:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822710:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822714:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822723:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822728:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822731:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822737:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63a00/0x9269c8b316066cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ccc expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822744:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966799.822747:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822753:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966799.822756:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822791:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966799.822798:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966799.822803:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783966799.822813:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822818:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966799.822822:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822828:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316066c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ca2 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.822838:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966799.822840:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966799.822842:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966799.822847:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966799.822853:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966799.822864:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832064:0@lo:103: 00000100:00100000:2.0:1783966799.822899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.822918:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832576:0@lo:103: 00000100:00100000:2.0:1783966799.822943:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.822962:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783966799.822967:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832192:0@lo:103: 00000100:00100000:2.0:1783966799.822990:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.823003:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832704:0@lo:103: 00000100:00100000:2.0:1783966799.823017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966799.823041:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832064 00000100:00100000:2.0:1783966799.823046:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832064 00010000:00010000:2.0:1783966799.823064:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966799.823080:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832576 00000100:00100000:2.0:1783966799.823082:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832576 00010000:00010000:2.0:1783966799.823089:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966799.823097:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832192 00000100:00100000:2.0:1783966799.823099:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832192 00010000:00010000:2.0:1783966799.823106:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 26 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966799.823114:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832704 00000100:00100000:2.0:1783966799.823115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832704 00010000:00010000:2.0:1783966799.823122:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 27 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966799.823134:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966799.823139:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+27:3645:x1870624587832064:12345-0@lo:103: 00010000:00010000:2.0:1783966799.823149:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966799.823154:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 27 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823163:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 27 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823183:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966799.823207:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+27:3645:x1870624587832064:12345-0@lo:103: Request processed in 67us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.823213:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783966799.823246:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966799.823250:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+26:3645:x1870624587832576:12345-0@lo:103: 00010000:00010000:2.0:1783966799.823256:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966799.823260:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 26 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823268:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 26 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823276:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966799.823290:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+26:3645:x1870624587832576:12345-0@lo:103: Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.823296:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966799.823305:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966799.823309:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+25:3645:x1870624587832192:12345-0@lo:103: 00010000:00010000:2.0:1783966799.823315:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966799.823319:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823326:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823334:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966799.823354:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+25:3645:x1870624587832192:12345-0@lo:103: Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.823360:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966799.823369:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966799.823374:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587832704:12345-0@lo:103: 00010000:00010000:2.0:1783966799.823380:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966799.823383:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823391:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.823400:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966799.823413:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587832704:12345-0@lo:103: Request processed in 39us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966799.823418:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966799.823477:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832192:0@lo:103: 00000100:00100000:2.0:1783966799.823485:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832704:0@lo:103: 00000100:00100000:2.0:1783966799.823491:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832064:0@lo:103: 00000100:00100000:2.0:1783966799.823497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587832576:0@lo:103: 00000100:00100000:3.0:1783966799.823787:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832320:0@lo:103: 00000100:00100000:3.0:1783966799.823817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966799.823840:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832832:0@lo:103: 00000100:00100000:3.0:1783966799.823855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966799.823868:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783966799.823873:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587831936:0@lo:103: 00000100:00100000:3.0:1783966799.823888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966799.823906:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832448:0@lo:103: 00000100:00100000:3.0:1783966799.823923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966799.823930:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832960:0@lo:103: 00000100:00100000:3.0:1783966799.823945:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966799.823962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832320 00000100:00100000:3.0:1783966799.823965:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832320 00010000:00010000:3.0:1783966799.823979:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 24 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.823994:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832832 00000100:00100000:3.0:1783966799.823995:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832832 00010000:00010000:3.0:1783966799.824003:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.824011:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587831936 00000100:00100000:3.0:1783966799.824019:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587831936 00010000:00010000:3.0:1783966799.824029:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 26 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.824038:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832448 00000100:00100000:3.0:1783966799.824040:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832448 00010000:00010000:3.0:1783966799.824047:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 27 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.824055:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587832960 00000100:00100000:3.0:1783966799.824057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587832960 00010000:00010000:3.0:1783966799.824064:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 28 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.824074:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966799.824079:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+28:3647:x1870624587832320:12345-0@lo:103: 00010000:00010000:3.0:1783966799.824086:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.824090:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 28 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824185:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 28 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824198:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.824225:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+28:3647:x1870624587832320:12345-0@lo:103: Request processed in 146us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.824232:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783966799.824245:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783966799.824250:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+27:3647:x1870624587832832:12345-0@lo:103: 00010000:00010000:3.0:1783966799.824256:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.824265:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 27 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824272:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 27 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824281:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.824299:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+27:3647:x1870624587832832:12345-0@lo:103: Request processed in 49us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.824305:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783966799.824315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783966799.824319:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+26:3647:x1870624587831936:12345-0@lo:103: 00010000:00010000:3.0:1783966799.824325:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.824329:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 26 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824337:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 26 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824345:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.824358:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+26:3647:x1870624587831936:12345-0@lo:103: Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.824363:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783966799.824372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783966799.824376:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+25:3647:x1870624587832448:12345-0@lo:103: 00010000:00010000:3.0:1783966799.824382:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.824385:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824402:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 25 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824410:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.824428:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+25:3647:x1870624587832448:12345-0@lo:103: Request processed in 52us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.824434:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783966799.824472:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783966799.824477:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587832960:12345-0@lo:103: 00010000:00010000:3.0:1783966799.824483:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.824487:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824494:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.824502:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.824521:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587832960:12345-0@lo:103: Request processed in 44us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.824526:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783966799.824559:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587831936:0@lo:103: 00000100:00100000:3.0:1783966799.824566:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832448:0@lo:103: 00000100:00100000:3.0:1783966799.824572:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832960:0@lo:103: 00000100:00100000:3.0:1783966799.824577:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832320:0@lo:103: 00000100:00100000:3.0:1783966799.824583:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587832832:0@lo:103: 00010000:00010000:0.0:1783966799.826851:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066dac expref: 23 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826893:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830784:0@lo:104: 00010000:00010000:0.0:1783966799.826921:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c1536800/0x9269c8b316066d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d82 expref: 22 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826930:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830912:0@lo:104: 00010000:00010000:0.0:1783966799.826940:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c1536200/0x9269c8b316066d66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d5f expref: 21 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826947:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831040:0@lo:104: 00010000:00010000:0.0:1783966799.826956:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031200/0x9269c8b316066d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d3c expref: 20 pid: 6511 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826965:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831168:0@lo:104: 00010000:00010000:0.0:1783966799.826973:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631200/0x9269c8b316066d27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d20 expref: 19 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826980:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831296:0@lo:104: 00010000:00010000:0.0:1783966799.826988:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631000/0x9269c8b316066d19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d12 expref: 18 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.826995:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831424:0@lo:104: 00010000:00010000:0.0:1783966799.827004:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031000/0x9269c8b316066d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066d04 expref: 17 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.827011:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831552:0@lo:104: 00010000:00010000:0.0:1783966799.827019:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066cc5 expref: 16 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.827034:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831680:0@lo:104: 00010000:00010000:0.0:1783966799.827045:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0031600/0x9269c8b316066ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066c9b expref: 15 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.827052:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587831808:0@lo:104: 00000100:00100000:0.0:1783966799.837665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966799.837826:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830528:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966799.837839:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1870624587830656:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966799.837884:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.838068:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663488 00000100:00100000:3.0:1783966799.838077:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663488 00010000:00010000:3.0:1783966799.838115:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 10 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966799.838157:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:3.0:1783966799.838166:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563663488:12345-192.168.204.59@tcp:103: 00010000:00010000:3.0:1783966799.838184:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966799.838189:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 10 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.838200:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 10 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.838220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630c00/0x9269c8b316066dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aaa expref: 10 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966799.838235:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966799.838297:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:2400:x1870624563663488:12345-192.168.204.59@tcp:103: Request processed in 131us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966799.838305:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783966799.844276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966799.844357:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663616 00000100:00100000:0.0:1783966799.844366:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663616 00010000:00010000:0.0:1783966799.844408:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966799.844463:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:0.0:1783966799.844474:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:2401:x1870624563663616:12345-192.168.204.59@tcp:103: 00010000:00010000:0.0:1783966799.844490:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966799.844496:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844508:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844525:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630e00/0x9269c8b316066dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6aa3 expref: 9 pid: 6510 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844542:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844550:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844592:0:9532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844601:0:9532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844607:0:9532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844613:0:9532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844619:0:9532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966799.844623:0:9532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844631:0:9532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844651:0:9532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.844662:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966799.844724:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:2401:x1870624563663616:12345-192.168.204.59@tcp:103: Request processed in 251us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966799.844733:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00010000:00010000:2.0:1783966799.844870:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.844886:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966799.844893:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050200/0x9269c8b316066e07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966799.929550:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966800.096034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.096126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663744 00000100:00100000:1.0:1783966800.096136:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663744 00000100:00100000:1.0:1783966800.096197:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:1.0:1783966800.096208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:6175:x1870624563663744:12345-192.168.204.59@tcp:101: 00010000:00010000:1.0:1783966800.096225:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966800.096246:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63000/0x9269c8b316066e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b1a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.096294:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63000/0x9269c8b316066e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b1a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.096307:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63000/0x9269c8b316066e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b1a expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.096316:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63000, rc 0) 00000100:00100000:1.0:1783966800.096420:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563663744:12345-192.168.204.59@tcp:101: Request processed in 213us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.096427:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:3.0:1783966800.110817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966800.110909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563663872 00000100:00100000:0.0:1783966800.110918:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563663872 00000100:00100000:0.0:1783966800.110992:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:0.0:1783966800.111002:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563663872:12345-192.168.204.59@tcp:501: 00000100:00100000:0.0:1783966800.111167:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563663872:12345-192.168.204.59@tcp:501: Request processed in 166us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966800.111175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:2.0:1783966800.114276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966800.116169:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664000 00000100:00100000:3.0:1783966800.116182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664000 00000100:00100000:3.0:1783966800.116252:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:3.0:1783966800.116262:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563664000:12345-192.168.204.59@tcp:503: 00000100:00100000:3.0:1783966800.116430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563664000:12345-192.168.204.59@tcp:503: Request processed in 169us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966800.116458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:2.0:1783966800.120669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.121515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664128 00000100:00100000:1.0:1783966800.121526:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664128 00000100:00100000:1.0:1783966800.121578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:1.0:1783966800.121587:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6648:x1870624563664128:12345-192.168.204.59@tcp:502: 00000100:00100000:1.0:1783966800.121751:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6648:x1870624563664128:12345-192.168.204.59@tcp:502: Request processed in 164us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.121758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:1.0:1783966800.127665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966800.127823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664256 00000100:00100000:0.0:1783966800.127833:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664256 00000100:00100000:0.0:1783966800.127892:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:0.0:1783966800.127901:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6648:x1870624563664256:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783966800.128066:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6648:x1870624563664256:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 165us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966800.128074:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:2.0:1783966800.131258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966800.131363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.131537:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664512 00000100:00100000:1.0:1783966800.131547:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664512 00000100:00100000:1.0:1783966800.131618:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1783966800.131627:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563664512:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966800.131693:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563664512:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 67us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.131700:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00080000:2.0:1783966800.131978:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966800.132693:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966800.132747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.132839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664384 00000100:00100000:1.0:1783966800.132845:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664384 00000100:00100000:1.0:1783966800.132893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1783966800.132901:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563664384:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966800.132989:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563664384:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.132996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00080000:2.0:1783966800.133165:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966800.133479:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664768 00000100:00100000:3.0:1783966800.133484:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664768 00000100:00100000:3.0:1783966800.133628:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664640 00000100:00100000:3.0:1783966800.133632:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664640 00000100:00100000:1.0:1783966800.133682:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783966800.133691:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563664768:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966800.133730:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563664768:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.133737:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:2.0:1783966800.137507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966800.137517:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966800.140966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.141034:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563664896 00000100:00100000:1.0:1783966800.141043:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563664896 00000100:00100000:1.0:1783966800.141091:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:1.0:1783966800.141107:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563664896:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966800.141122:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966800.141138:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b21 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.141164:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b21 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.141175:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b21 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966800.141184:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63a00, rc 0) 00000100:00100000:1.0:1783966800.141242:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563664896:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966800.141248:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:0.0:1783966800.145602:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783966800.145621:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563664640:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966800.145715:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563664640:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 101us (12966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966800.145723:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783966800.151276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966800.152648:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665024 00000100:00100000:1.0:1783966800.152661:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665024 00000100:00100000:1.0:1783966800.152729:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:1.0:1783966800.152740:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665024:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966800.152885:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665024:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 147us (1618us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783966800.152894:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:3.0:1783966800.247081:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966800.247109:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587833088:0@lo:41: 00000100:00100000:3.0:1783966800.247177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966800.247304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833088 00000100:00100000:0.0:1783966800.247312:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833088 00000100:00100000:0.0:1783966800.247368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783966800.247377:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587833088:12345-0@lo:41: 00000004:00000024:0.0:1783966800.247423:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966800.247486:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587833088:12345-0@lo:41: Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966800.247493:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783966800.247721:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587833088:0@lo:41: 00010000:00010000:2.0:1783966800.950993:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783966801.591188:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783966801.591194:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ef299800 from 48 10000000:01000000:1.0:1783966801.591198:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783966801.591244:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.591256:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.591266:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.591291:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833216:0@lo:101: 00000100:00100000:1.0:1783966801.591357:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.591417:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783966801.591472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833216 00000100:00100000:2.0:1783966801.591479:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833216 00000100:00100000:2.0:1783966801.591531:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1783966801.591540:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+15:6515:x1870624587833216:12345-0@lo:101: 00010000:00010000:2.0:1783966801.591552:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966801.591565:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631a00/0x9269c8b316066e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e1c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.591586:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631a00/0x9269c8b316066e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e1c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.591603:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631a00/0x9269c8b316066e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e1c expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.591611:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631a00, rc 0) 00000100:00100000:2.0:1783966801.591661:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833216:12345-0@lo:101: Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.591667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783966801.591859:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833216:0@lo:101: 00010000:00010000:0.0:1783966801.591873:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.591881:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.591934:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833344:0@lo:501: 00000100:00100000:0.0:1783966801.591960:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.591986:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.592026:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833344 00000100:00100000:1.0:1783966801.592031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833344 00000100:00100000:1.0:1783966801.592056:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783966801.592063:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833344:12345-0@lo:501: 00000100:00100000:1.0:1783966801.592182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833344:12345-0@lo:501: Request processed in 118us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.592188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783966801.592251:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833344:0@lo:501: 00000100:00100000:0.0:1783966801.592276:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833472:0@lo:503: 00000100:00100000:0.0:1783966801.592313:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.592334:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.592376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833472 00000100:00100000:1.0:1783966801.592380:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833472 00000100:00100000:1.0:1783966801.592420:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966801.592426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833472:12345-0@lo:503: 00000100:00100000:1.0:1783966801.592515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833472:12345-0@lo:503: Request processed in 89us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.592521:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966801.592557:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833472:0@lo:503: 00000100:00100000:1.0:1783966801.592755:0:10365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10365:1870624587833600:0@lo:502: 00000100:00100000:1.0:1783966801.592809:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.592826:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833600 00000100:00100000:1.0:1783966801.592829:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833600 00000100:00100000:1.0:1783966801.592848:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783966801.592853:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:10365:x1870624587833600:12345-0@lo:502: 00000100:00100000:1.0:1783966801.592939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:10365:x1870624587833600:12345-0@lo:502: Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.592945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783966801.592970:0:10365:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.592981:0:10365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10365:1870624587833600:0@lo:502: 00000100:00100000:1.0:1783966801.593012:0:10365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10365:1870624587833728:0@lo:502: 00000100:00100000:1.0:1783966801.593040:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.593057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833728 00000100:00100000:1.0:1783966801.593065:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833728 00000100:00100000:1.0:1783966801.593082:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783966801.593087:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:10365:x1870624587833728:12345-0@lo:502: 00000100:00100000:1.0:1783966801.593139:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:10365:x1870624587833728:12345-0@lo:502: Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.593145:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783966801.593169:0:10365:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.593180:0:10365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10365:1870624587833728:0@lo:502: 00000040:00080000:1.0:1783966801.593198:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783966801.593270:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783966801.593288:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783966801.593296:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593303:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966801.593312:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783966801.593314:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783966801.593316:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783966801.593335:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593342:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593351:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.593362:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833856:0@lo:101: 00000100:00100000:1.0:1783966801.593392:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.593416:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.593427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833856 00000100:00100000:1.0:1783966801.593431:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833856 00000100:00100000:1.0:1783966801.593447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783966801.593454:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+16:6515:x1870624587833856:12345-0@lo:101: 00010000:00010000:1.0:1783966801.593461:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966801.593472:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e2a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593487:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e2a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593497:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e2a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593504:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62600, rc 0) 00000100:00100000:1.0:1783966801.593530:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587833856:12345-0@lo:101: Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.593535:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1783966801.593561:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833856:0@lo:101: 00010000:00010000:1.0:1783966801.593571:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.593578:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.593612:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833984:0@lo:501: 00000100:00100000:1.0:1783966801.593643:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.593654:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.593665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587833984 00000100:00100000:1.0:1783966801.593668:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587833984 00000100:00100000:1.0:1783966801.593684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783966801.593689:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587833984:12345-0@lo:501: 00000100:00100000:1.0:1783966801.593794:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587833984:12345-0@lo:501: Request processed in 104us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.593800:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783966801.593826:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587833984:0@lo:501: 00000100:00100000:1.0:1783966801.593848:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834112:0@lo:503: 00000100:00100000:1.0:1783966801.593878:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.593890:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.593901:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834112 00000100:00100000:1.0:1783966801.593904:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834112 00000100:00100000:1.0:1783966801.593919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783966801.593925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587834112:12345-0@lo:503: 00000100:00100000:1.0:1783966801.593985:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587834112:12345-0@lo:503: Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.593992:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783966801.594025:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834112:0@lo:503: 00000100:00100000:0.0:1783966801.594611:0:10366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10366:1870624587834240:0@lo:502: 00000100:00100000:0.0:1783966801.594652:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.594683:0:10366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.594724:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834240 00000100:00100000:1.0:1783966801.594729:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834240 00000100:00100000:1.0:1783966801.594760:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783966801.594921:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:10366:x1870624587834240:12345-0@lo:502: 00000100:00100000:1.0:1783966801.595013:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:10366:x1870624587834240:12345-0@lo:502: Request processed in 246us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.595026:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783966801.595100:0:10366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10366:1870624587834240:0@lo:502: 00000020:01000000:0.0:1783966801.595124:0:10366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966801.595132:0:10366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966801.595135:0:10366:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783966801.595140:0:10366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783966801.595162:0:10366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10366:1870624587834368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.595194:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.595248:0:10366:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966801.597599:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834368 00000100:00100000:2.0:1783966801.597613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834368 00000100:00100000:2.0:1783966801.597662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783966801.597671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:10366:x1870624587834368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.598010:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+17:10366:x1870624587834368:12345-0@lo:502:llog_process_th.0 Request processed in 339us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.598018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783966801.601209:0:10366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10366:1870624587834368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783966801.601258:0:10366:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966801.601265:0:10366:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966801.601268:0:10366:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783966801.601271:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1783966801.601377:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783966801.601423:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783966801.601435:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601456:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966801.601465:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783966801.601468:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05fcff3800 from 48 10000000:01000000:1.0:1783966801.601470:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783966801.601504:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601511:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601520:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.601540:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.601598:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.601633:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97900 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.601650:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834496 00000100:00100000:1.0:1783966801.601654:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834496 00000100:00100000:1.0:1783966801.601696:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783966801.601705:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+17:6515:x1870624587834496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966801.601717:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966801.601734:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066e3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e38 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601756:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e38 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601766:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066e3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e38 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601798:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62200, rc 0) 00000100:00100000:1.0:1783966801.601833:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587834496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.601840:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783966801.601881:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966801.601894:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.601902:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.601946:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.601970:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.601984:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97900 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.601995:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834624 00000100:00100000:1.0:1783966801.601998:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834624 00000100:00100000:1.0:1783966801.602016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783966801.602022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587834624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.602119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587834624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.602132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783966801.602161:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.602184:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.602220:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.602233:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97900 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.602243:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834752 00000100:00100000:1.0:1783966801.602246:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834752 00000100:00100000:1.0:1783966801.602265:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783966801.602271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587834752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.602342:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587834752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.602348:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783966801.602384:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587834752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.607525:0:10368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10368:1870624587834880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.607605:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.607646:0:10368:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.607693:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587834880 00000100:00100000:1.0:1783966801.607700:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587834880 00000100:00100000:1.0:1783966801.607747:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783966801.607757:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:10368:x1870624587834880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.607909:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+18:10368:x1870624587834880:12345-0@lo:502:llog_process_th.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.607917:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783966801.608016:0:10368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10368:1870624587834880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966801.608062:0:10368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10368:1870624587835008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966801.608094:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.608114:0:10368:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.608166:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835008 00000100:00100000:0.0:1783966801.608170:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835008 00000100:00100000:0.0:1783966801.608202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783966801.608209:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:10368:x1870624587835008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.608272:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:10368:x1870624587835008:12345-0@lo:502:llog_process_th.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.608279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783966801.608346:0:10368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10368:1870624587835008:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783966801.608364:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783966801.608592:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783966801.608630:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783966801.608640:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.608651:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966801.608660:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783966801.608662:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783966801.608666:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783966801.608690:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.608698:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.608714:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.608728:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.608755:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.608801:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.608850:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835136 00000100:00100000:1.0:1783966801.608854:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835136 00000100:00100000:1.0:1783966801.608879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783966801.608885:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+18:6515:x1870624587835136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966801.608901:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966801.608913:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62000/0x9269c8b316066e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e46 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.608935:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62000/0x9269c8b316066e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e46 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.608945:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62000/0x9269c8b316066e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e46 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.608953:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62000, rc 0) 00000100:00100000:1.0:1783966801.608991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.608998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783966801.609088:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966801.609101:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.609110:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.609165:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.609190:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.609209:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e12e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.609248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835264 00000100:00100000:1.0:1783966801.609252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835264 00000100:00100000:1.0:1783966801.609280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783966801.609287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.609526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.609533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783966801.612220:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.612282:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.612353:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.612394:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.612458:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835392 00000100:00100000:1.0:1783966801.612464:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835392 00000100:00100000:1.0:1783966801.612518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1783966801.612528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.612643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.612659:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783966801.612858:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966801.613240:0:10370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10370:1870624587835520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.613277:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966801.613307:0:10370:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.613346:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835520 00000100:00100000:1.0:1783966801.613350:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835520 00000100:00100000:1.0:1783966801.613382:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1783966801.613389:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:10370:x1870624587835520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.613601:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:10370:x1870624587835520:12345-0@lo:502:llog_process_th.0 Request processed in 211us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.613609:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783966801.615607:0:10370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10370:1870624587835520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783966801.615659:0:10370:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966801.615670:0:10370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966801.615672:0:10370:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783966801.615677:0:10370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783966801.615716:0:10370:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10370:1870624587835648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.615808:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966801.615846:0:10370:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.615947:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835648 00000100:00100000:0.0:1783966801.615953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835648 00000100:00100000:0.0:1783966801.616002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783966801.616012:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+19:10370:x1870624587835648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.616140:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+19:10370:x1870624587835648:12345-0@lo:502:llog_process_th.0 Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.616149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783966801.616243:0:10370:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10370:1870624587835648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783966801.616265:0:10370:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966801.616270:0:10370:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966801.616271:0:10370:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783966801.616275:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1783966801.616513:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1783966801.616536:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783966801.616547:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.616559:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966801.616569:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783966801.616571:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f1a14000 from 48 10000000:01000000:1.0:1783966801.616574:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783966801.616601:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.616609:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.616619:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.616633:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.616672:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.616699:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.616744:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835776 00000100:00100000:0.0:1783966801.616749:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835776 00000100:00100000:0.0:1783966801.616904:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783966801.616919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+19:6515:x1870624587835776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966801.616930:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966801.616943:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050200/0x9269c8b316066e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e54 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.616966:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050200/0x9269c8b316066e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e54 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.616976:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050200/0x9269c8b316066e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e54 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.616984:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050200, rc 0) 00000100:00100000:0.0:1783966801.617079:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587835776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.617085:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783966801.620934:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966801.620965:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.620979:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.621069:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.621133:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.621181:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.621232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587835904 00000100:00100000:0.0:1783966801.621238:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587835904 00000100:00100000:0.0:1783966801.621291:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783966801.621300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587835904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.621439:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587835904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.621523:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783966801.621869:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.621902:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.621943:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.621958:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.622018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836032 00000100:00100000:0.0:1783966801.622023:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836032 00000100:00100000:0.0:1783966801.622058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783966801.622065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587836032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.622141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587836032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.622153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783966801.622224:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.622663:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10372:1870624587836160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.622701:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.624530:0:10372:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.624753:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836160 00000100:00100000:0.0:1783966801.624762:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836160 00000100:00100000:0.0:1783966801.624820:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783966801.624828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:10372:x1870624587836160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.624974:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:10372:x1870624587836160:12345-0@lo:502:llog_process_th.0 Request processed in 146us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.624982:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783966801.625650:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10372:1870624587836160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.625715:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10372:1870624587836288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.625755:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.625806:0:10372:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f89d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.625864:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836288 00000100:00100000:0.0:1783966801.625869:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836288 00000100:00100000:0.0:1783966801.625930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783966801.625937:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:10372:x1870624587836288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.626015:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:10372:x1870624587836288:12345-0@lo:502:llog_process_th.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.626022:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783966801.626629:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10372:1870624587836288:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783966801.626656:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1783966801.626761:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1783966801.626826:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783966801.626837:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.626848:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966801.626857:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1783966801.626860:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1783966801.626863:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783966801.626908:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.626916:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.626925:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966801.626941:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.626975:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.627003:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f89540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.627081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836416 00000100:00100000:0.0:1783966801.627086:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836416 00000100:00100000:0.0:1783966801.627120:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783966801.627127:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587836416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966801.627137:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966801.627150:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602051a00/0x9269c8b316066e69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e62 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.627171:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602051a00/0x9269c8b316066e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e62 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.627182:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602051a00/0x9269c8b316066e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e62 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.627199:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051a00, rc 0) 00000100:00100000:0.0:1783966801.627242:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587836416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.627250:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783966801.627315:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966801.627328:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.627346:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.627397:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.627435:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.627509:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.627539:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836544 00000100:00100000:0.0:1783966801.627542:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836544 00000100:00100000:0.0:1783966801.627564:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783966801.627570:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587836544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.627819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587836544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.627826:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783966801.627873:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.627897:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.627928:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.627942:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783966801.628045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836672 00000100:00100000:2.0:1783966801.628050:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836672 00000100:00100000:2.0:1783966801.628086:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783966801.628092:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587836672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966801.628176:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587836672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.628183:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783966801.628518:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587836672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966801.628840:0:10373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10373:1870624587836800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.628878:0:10373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966801.628905:0:10373:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.628906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836800 00000100:00100000:0.0:1783966801.628911:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836800 00000100:00100000:0.0:1783966801.628941:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1783966801.628948:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:10373:x1870624587836800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.629045:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:10373:x1870624587836800:12345-0@lo:502:llog_process_th.0 Request processed in 96us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.629052:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783966801.629156:0:10373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10373:1870624587836800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783966801.629184:0:10373:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966801.629192:0:10373:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966801.629195:0:10373:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783966801.629201:0:10373:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783966801.629220:0:10373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10373:1870624587836928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.629251:0:10373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966801.629300:0:10373:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966801.629328:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587836928 00000100:00100000:3.0:1783966801.629332:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587836928 00000100:00100000:3.0:1783966801.629391:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783966801.629398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:10373:x1870624587836928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.629614:0:10373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10373:1870624587836928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966801.629615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:10373:x1870624587836928:12345-0@lo:502:llog_process_th.0 Request processed in 216us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.629622:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000020:01000000:2.0:1783966801.629638:0:10373:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966801.629642:0:10373:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966801.629643:0:10373:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783966801.629647:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1783966801.629815:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1783966801.629835:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783966801.629842:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.629853:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.629868:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783966801.629870:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05ed1cf800 from 48 10000000:01000000:3.0:1783966801.629873:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783966801.629895:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.629902:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.629911:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.629925:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.629953:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.629967:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:2.0:1783966801.630025:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837056 00000100:00100000:2.0:1783966801.630030:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837056 00000100:00100000:2.0:1783966801.630066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783966801.630234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587837056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966801.630244:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966801.630255:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630800/0x9269c8b316066e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e70 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.630274:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630800/0x9269c8b316066e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e70 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.630285:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630800/0x9269c8b316066e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e70 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.630292:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630800, rc 0) 00000100:00100000:2.0:1783966801.630328:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.630370:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966801.630381:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.630390:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.630457:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.630484:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.630516:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.630615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837184 00000100:00100000:0.0:1783966801.630620:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837184 00000100:00100000:2.0:1783966801.630673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783966801.630763:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783966801.630798:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.630899:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.630905:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783966801.631110:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.631139:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.631178:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.631488:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.631564:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837312 00000100:00100000:1.0:1783966801.631569:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837312 00000100:00100000:1.0:1783966801.631593:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783966801.631600:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.631690:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.631698:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783966801.631796:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966801.632069:0:10374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10374:1870624587837440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.632110:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.632382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837440 00000100:00100000:1.0:1783966801.632386:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837440 00000100:00100000:2.0:1783966801.632396:0:10374:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.632493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783966801.632502:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:10374:x1870624587837440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966801.632591:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:10374:x1870624587837440:12345-0@lo:502:llog_process_th.0 Request processed in 91us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.632599:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783966801.632670:0:10374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10374:1870624587837440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.632717:0:10374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10374:1870624587837568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.632755:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966801.632852:0:10374:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.632907:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837568 00000100:00100000:0.0:1783966801.632912:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837568 00000100:00100000:0.0:1783966801.632942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783966801.632949:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:10374:x1870624587837568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.633048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:10374:x1870624587837568:12345-0@lo:502:llog_process_th.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.633055:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783966801.633106:0:10374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10374:1870624587837568:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783966801.633395:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783966801.633520:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783966801.633540:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783966801.633550:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.633562:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.633571:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783966801.633573:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1783966801.633576:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783966801.633605:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.633612:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.633620:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.633635:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.633666:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.633892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837696 00000100:00100000:1.0:1783966801.633898:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837696 00000100:00100000:3.0:1783966801.633909:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.633965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783966801.633974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587837696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966801.633983:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966801.633994:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274fc00/0x9269c8b316066e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e7e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.634014:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fc00/0x9269c8b316066e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e7e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.634023:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274fc00/0x9269c8b316066e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e7e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.634030:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fc00, rc 0) 00000100:00100000:1.0:1783966801.634152:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587837696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.634159:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1783966801.634243:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966801.634255:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.634272:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.634322:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.634348:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.634362:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.634468:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837824 00000100:00100000:0.0:1783966801.634473:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837824 00000100:00100000:0.0:1783966801.634503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783966801.634510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587837824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.634613:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587837824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.634620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783966801.634684:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.634709:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.634743:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.634764:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1783966801.634838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587837952 00000100:00100000:1.0:1783966801.634843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587837952 00000100:00100000:1.0:1783966801.634939:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783966801.634947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587837952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966801.635078:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587837952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.635088:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783966801.635102:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587837952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.635832:0:10375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10375:1870624587838080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966801.635871:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.635944:0:10375:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.636159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838080 00000100:00100000:0.0:1783966801.636166:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838080 00000100:00100000:0.0:1783966801.636238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783966801.636247:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:10375:x1870624587838080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966801.636345:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:10375:x1870624587838080:12345-0@lo:502:llog_process_th.0 Request processed in 100us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.636353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783966801.636426:0:10375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10375:1870624587838080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966801.636462:0:10375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966801.636470:0:10375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966801.636472:0:10375:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783966801.636478:0:10375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783966801.636497:0:10375:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10375:1870624587838208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966801.636529:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.637883:0:10375:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1783966801.638038:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838208 00000100:00100000:2.0:1783966801.638045:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838208 00000100:00100000:2.0:1783966801.638098:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783966801.638107:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:10375:x1870624587838208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966801.638290:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:10375:x1870624587838208:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.638299:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783966801.638575:0:10375:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10375:1870624587838208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966801.638614:0:10375:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966801.638621:0:10375:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966801.638623:0:10375:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783966801.638628:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1783966801.639023:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1783966801.639044:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783966801.639053:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.639065:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.639085:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783966801.639087:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:3.0:1783966801.639090:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783966801.639116:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.639125:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.639135:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.639153:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587838336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.639190:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.639222:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.639269:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838336 00000100:00100000:0.0:1783966801.639275:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838336 00000100:00100000:0.0:1783966801.639310:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783966801.639318:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587838336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966801.639328:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966801.639349:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602051000/0x9269c8b316066e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066e8c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.639380:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602051000/0x9269c8b316066e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066e8c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.639392:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602051000/0x9269c8b316066e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066e8c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.639401:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051000, rc 0) 00000100:00100000:0.0:1783966801.639457:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587838336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.639466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783966801.639691:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587838336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966801.639705:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.639721:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.639793:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587838464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966801.639818:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.639840:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966801.639885:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838464 00000100:00100000:0.0:1783966801.639889:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838464 00000100:00100000:0.0:1783966801.639917:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783966801.639924:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587838464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966801.639986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587838464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783966801.639993:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783966801.640018:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587838464:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783966801.640038:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783966801.640043:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.640050:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.782985:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587838592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966801.782985:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587838848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966801.783063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.783142:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966801.783155:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838592 00000100:00100000:0.0:1783966801.783165:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838592 00000100:00100000:3.0:1783966801.783171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.783207:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838720 00000100:00100000:3.0:1783966801.783211:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838720 00000100:00100000:0.0:1783966801.783237:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783966801.783312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966801.783354:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587838592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783966801.783493:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966801.783539:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587838592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 293us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.787680:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587838976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966801.787755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.787841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.787918:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783966801.787929:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1783966801.788042:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838976 00000100:00100000:0.0:1783966801.788049:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838976 00000100:00100000:0.0:1783966801.788094:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783966801.788099:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587838848 00000100:00100000:0.0:1783966801.788102:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587838848 00000100:00100000:0.0:1783966801.788184:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783966801.788204:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587838720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966801.788230:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966801.788281:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587838720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.788289:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783966801.788307:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783966801.788313:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587838976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966801.788330:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966801.788361:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587838976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.788368:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783966801.788380:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783966801.788393:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587838848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966801.788412:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966801.788438:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587838848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.788444:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1783966801.789086:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6f800 x1870624587838848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966801.789108:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587838848:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783966801.789146:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6ca80 x1870624587838720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966801.789158:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587838720:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783966801.789178:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d58380 x1870624587838976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966801.789190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587838976:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783966801.789227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4cace00 x1870624587838592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966801.789239:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587838592:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783966801.789747:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966801.791810:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783966801.793135:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587839104:0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.793206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.793320:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839104 00000100:00100000:1.0:1783966801.793328:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839104 00000100:00100000:1.0:1783966801.793391:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783966801.793400:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587839104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.793462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587839104:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.793469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783966801.794009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587839232:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.794042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.794077:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587839744:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.794099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.794126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783966801.794131:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587839360:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.794151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.794350:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587839872:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.794374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.794489:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839744 00000100:00100000:0.0:1783966801.794489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839232 00000100:00100000:1.0:1783966801.794494:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839744 00000100:00100000:0.0:1783966801.794497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839232 00000100:00100000:0.0:1783966801.794535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783966801.794544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587839232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966801.794593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587839232:12345-0@lo:400:kworker.0 Request processed in 50us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.794602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966801.794616:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839360 00000100:00100000:3.0:1783966801.794622:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839360 00000100:00100000:3.0:1783966801.794658:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839872 00000100:00100000:3.0:1783966801.794662:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839872 00000100:00100000:3.0:1783966801.794689:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966801.794696:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587839360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.794731:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587839360:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.794737:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966801.794748:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783966801.794754:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587839872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.794800:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587839872:12345-0@lo:400:kworker.0 Request processed in 46us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.794806:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1783966801.794826:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966801.794838:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587839616:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783966801.795616:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795669:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587839744:12345-0@lo:400:kworker.0 Request processed in 55us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966801.795676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783966801.795726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587839360:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795739:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587839872:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795751:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587839232:0@lo:400:kworker.0 00010000:00080000:1.0:1783966801.795765:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d180 x1870624587839744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966801.795795:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587839744:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795826:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587839488:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966801.795889:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587840000:0@lo:400:kworker.0 00000100:00100000:1.0:1783966801.795908:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.795943:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839488 00000100:00100000:0.0:1783966801.795950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839488 00000100:00100000:0.0:1783966801.795987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783966801.795999:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966801.796008:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587839488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.796039:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587839104:0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.796062:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840000 00000100:00100000:0.0:1783966801.796066:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587839488:12345-0@lo:400:kworker.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.796067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840000 00000100:00100000:0.0:1783966801.796076:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783966801.796108:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587839616 00000100:00100000:3.0:1783966801.796112:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587839616 00000100:00100000:0.0:1783966801.796113:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783966801.796124:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587840000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966801.796141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783966801.796151:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587839616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966801.796158:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587840000:12345-0@lo:400:kworker.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966801.796164:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783966801.796209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587839616:12345-0@lo:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.796216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1783966801.796251:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966801.796255:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966801.796501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587839488:0@lo:400:kworker.0 00010000:00080000:1.0:1783966801.796592:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6f100 x1870624587840000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966801.796603:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587840000:0@lo:400:kworker.0 00000100:00100000:0.0:1783966801.799635:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587839616:0@lo:400:kworker.0 00000020:00000080:1.0:1783966801.871079:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd6439330 20000000:00000080:1.0:1783966801.871095:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a04c3d51000 uarg=0000000000000000 20000000:01000000:1.0:1783966801.871133:0:10395:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783966801.871139:0:10395:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783966801.871148:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783966801.871831:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783966801.872085:0:10395:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1783966801.880161:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1783966801.880210:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1783966801.880227:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1783966801.880243:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783966801.880262:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880280:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b2f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880288:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b3d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880295:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066b91 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880302:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880312:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966801.880320:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880422:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880438:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 9 pid: 6512 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.880452:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840128:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966801.880562:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880570:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 23 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.880579:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840256:0@lo:104: 00000100:00100000:0.0:1783966801.880614:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966801.880647:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880655:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 23 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.880664:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840384:0@lo:104: 00000100:00100000:0.0:1783966801.880681:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966801.880707:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880715:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 23 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.880723:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840512:0@lo:104: 00010000:00010000:0.0:1783966801.880753:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.880760:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 23 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.880789:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840640:0@lo:104: 00000100:00100000:0.0:1783966801.880806:0:10395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966801.880879:0:9520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783966801.880896:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.880916:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.880924:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840256 00000100:00100000:3.0:1783966801.880930:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840256 00000100:00100000:3.0:1783966801.880961:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840384 00000100:00100000:3.0:1783966801.880964:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840384 00000100:00100000:3.0:1783966801.880972:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840512 00000100:00100000:3.0:1783966801.880973:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840512 00000100:00100000:3.0:1783966801.880980:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840640 00000100:00100000:3.0:1783966801.880982:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840640 00000100:00100000:3.0:1783966801.880993:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783966801.881000:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+6:10395:x1870624587840256:12345-0@lo:104: 00010000:00010000:3.0:1783966801.881011:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881051:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783966801.881056:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+6:10395:x1870624587840256:12345-0@lo:104: Request processed in 57us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.881072:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783966801.881086:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783966801.881097:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef0d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+5:10395:x1870624587840384:12345-0@lo:104: 00010000:00010000:3.0:1783966801.881105:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881135:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783966801.881139:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef0d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+5:10395:x1870624587840384:12345-0@lo:104: Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.881145:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783966801.881175:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966801.881181:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:10395:x1870624587840512:12345-0@lo:104: 00010000:00010000:3.0:1783966801.881188:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881210:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783966801.881215:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+4:10395:x1870624587840512:12345-0@lo:104: Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.881220:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966801.881229:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783966801.881233:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+3:10395:x1870624587840640:12345-0@lo:104: 00010000:00010000:3.0:1783966801.881239:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881257:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783966801.881261:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+3:10395:x1870624587840640:12345-0@lo:104: Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.881267:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1783966801.881279:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783966801.881288:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881295:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966801.881299:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881307:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966801.881313:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.881320:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966801.881340:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881346:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966801.881361:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1000/0x9269c8b316066cb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066cbe expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881379:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783966801.881381:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881387:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966801.881389:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881416:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966801.881422:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.881427:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966801.881442:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881447:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966801.881461:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881467:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0031400/0x9269c8b316066b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b98 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881477:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783966801.881480:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881486:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c1537600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966801.881489:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881495:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966801.881500:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.881510:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966801.881521:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881526:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966801.881532:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881539:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1537600/0x9269c8b316066b3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b44 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881547:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966801.881549:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881554:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c1537000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966801.881557:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881563:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966801.881570:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966801.881575:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783966801.881583:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881588:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966801.881598:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881604:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1537000/0x9269c8b316066b2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066b36 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881615:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966801.881617:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966801.881618:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966801.881629:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587840768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966801.881654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.881690:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966801.881695:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587841152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966801.881712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.881729:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587841024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966801.881745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.881758:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966801.881762:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587840896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966801.881804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966801.881822:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840768 00000100:00100000:3.0:1783966801.881826:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840768 00010000:00010000:3.0:1783966801.881842:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 24 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.881854:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841152 00000100:00100000:3.0:1783966801.881856:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841152 00010000:00010000:3.0:1783966801.881863:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 25 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.881871:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841024 00000100:00100000:3.0:1783966801.881877:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841024 00010000:00010000:3.0:1783966801.881886:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 26 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.881895:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587840896 00000100:00100000:3.0:1783966801.881897:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587840896 00010000:00010000:3.0:1783966801.881903:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 27 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.881913:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966801.881918:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+27:3646:x1870624587840768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783966801.881926:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966801.881931:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 27 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881940:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 27 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.881954:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966801.881975:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+27:3646:x1870624587840768:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.881981:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966801.881991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783966801.881996:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+26:3646:x1870624587841152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966801.882458:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966801.882466:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966801.882479:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783966801.882489:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+26:3648:x1870624587841024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966801.882498:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966801.882504:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 26 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.882513:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 26 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.882523:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966801.882559:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+26:3648:x1870624587841024:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.882565:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783966801.882588:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783966801.882593:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+25:3648:x1870624587840896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966801.882601:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966801.882605:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 25 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.882613:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 25 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966801.882622:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966801.882642:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e80b464-a486-4100-b63a-6e6116a9d437+25:3648:x1870624587840896:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966801.882648:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783966801.882678:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587840896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966801.882687:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587841024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783966801.882807:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030400/0x9269c8b316066cbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066cb7 expref: 24 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.882820:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840256:0@lo:104: 00010000:00010000:0.0:1783966801.882830:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b91 expref: 23 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.882837:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840384:0@lo:104: 00010000:00010000:0.0:1783966801.882846:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602179800/0x9269c8b316066b44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b3d expref: 22 pid: 6512 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966801.882855:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840512:0@lo:104: 00000100:00100000:0.0:1783966801.882863:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840640:0@lo:104: 00010000:00010000:3.0:1783966801.883269:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966801.883276:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 21 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.883285:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 21 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.883305:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c1537c00/0x9269c8b316066b36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066b2f expref: 21 pid: 6510 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.883314:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966801.883339:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+20:3646:x1870624587841152:12345-0@lo:103:ldlm_bl.0 Request processed in 1343us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.883345:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783966801.883555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587841152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966801.883569:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587840768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966801.892463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966801.892685:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1870624587840128:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966801.892719:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.893035:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665152 00000100:00100000:3.0:1783966801.893043:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665152 00010000:00010000:3.0:1783966801.893089:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966801.893123:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1783966801.893131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2401:x1870624563665152:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966801.893144:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966801.893149:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893160:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893177:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63c00/0x9269c8b316066dd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ae2 expref: 10 pid: 6512 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893899:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893922:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893938:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893945:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893952:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893958:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893964:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966801.893967:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893974:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893984:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.893995:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966801.894060:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:2401:x1870624563665152:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 927us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966801.894168:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00010000:00010000:0.0:1783966801.894690:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.894700:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966801.894716:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274e800/0x9269c8b316066e9a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966801.979970:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966802.295042:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587841280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966802.295126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966802.295417:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841280 00000100:00100000:3.0:1783966802.295426:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841280 00000100:00100000:3.0:1783966802.295486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783966802.295496:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587841280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966802.295531:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966802.296580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587841280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1081us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966802.296590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783966802.296824:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587841280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966803.001347:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966803.394881:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966803.394941:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665280 00000100:00100000:2.0:1783966803.394951:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665280 00000100:00100000:2.0:1783966803.395006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:2.0:1783966803.395017:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+9:6175:x1870624563665280:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966803.395035:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966803.395056:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b28 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966803.395087:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966803.395099:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966803.395123:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783966803.395193:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665280:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966803.395201:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:2.0:1783966803.403331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966803.405570:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665408 00000100:00100000:0.0:1783966803.405583:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665408 00000100:00100000:0.0:1783966803.405648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:0.0:1783966803.405659:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665408:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.405873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665408:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 215us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.405882:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:3.0:1783966803.408422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966803.408517:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665536 00000100:00100000:2.0:1783966803.408526:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665536 00000100:00100000:2.0:1783966803.408627:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 250 00000100:00100000:2.0:1783966803.408638:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665536:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966803.408812:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6175:x1870624563665536:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966803.408821:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 250 00000100:00100000:2.0:1783966803.412932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966803.413021:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665664 00000100:00100000:0.0:1783966803.413031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665664 00000100:00100000:0.0:1783966803.413133:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:0.0:1783966803.413146:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6712:x1870624563665664:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783966803.413326:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6712:x1870624563665664:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.413335:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:1.0:1783966803.427935:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966803.430367:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665792 00000100:00100000:2.0:1783966803.430390:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665792 00000100:00100000:2.0:1783966803.430452:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 252 00000100:00100000:2.0:1783966803.430462:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6712:x1870624563665792:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783966803.430615:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:6712:x1870624563665792:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 154us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966803.430624:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 252 10000000:01000000:0.0:1783966803.766859:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783966803.766867:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ef299800 from 4 10000000:01000000:0.0:1783966803.766873:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966803.766919:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.766941:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.766953:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966803.766980:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.767048:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966803.767100:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.767477:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841408 00000100:00100000:1.0:1783966803.767487:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841408 00000100:00100000:1.0:1783966803.767537:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783966803.767553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587841408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966803.767567:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966803.767582:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ea8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.767606:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.767617:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.767625:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966803.767682:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587841408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.767688:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783966803.767762:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966803.767796:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.767807:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966803.767870:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.767914:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.767945:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966803.767966:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841536 00000100:00100000:0.0:1783966803.767972:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841536 00000100:00100000:0.0:1783966803.768004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1783966803.768011:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587841536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.768128:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587841536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.768136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783966803.768154:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.768183:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.768222:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.768259:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966803.768362:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841664 00000100:00100000:0.0:1783966803.768375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841664 00000100:00100000:0.0:1783966803.768410:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783966803.768417:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587841664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.768507:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587841664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.768514:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1783966803.768631:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587841664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.769466:0:10481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10481:1870624587841792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.769510:0:10481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966803.769579:0:10481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97840 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.776980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841792 00000100:00100000:1.0:1783966803.776994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841792 00000100:00100000:0.0:1783966803.781513:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783966803.781529:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:10481:x1870624587841792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.781723:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:10481:x1870624587841792:12345-0@lo:502:llog_process_th.0 Request processed in 197us (12210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.781732:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783966803.783953:0:10481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10481:1870624587841792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.783999:0:10481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966803.784011:0:10481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.784013:0:10481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783966803.784020:0:10481:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05ef299800 00000020:00000080:1.0:1783966803.784023:0:10481:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783966803.784124:0:10481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10481:1870624587841920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.788805:0:10481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.788848:0:10481:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97840 going to sleep for 11 seconds 00000100:00100000:0.0:1783966803.789997:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587841920 00000100:00100000:0.0:1783966803.790009:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587841920 00000100:00100000:0.0:1783966803.790071:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783966803.790081:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:10481:x1870624587841920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.790248:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:10481:x1870624587841920:12345-0@lo:502:llog_process_th.0 Request processed in 168us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.790256:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783966803.790655:0:10481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10481:1870624587841920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.790698:0:10481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966803.790706:0:10481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.790708:0:10481:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783966803.790712:0:10481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783966803.792435:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783966803.792471:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783966803.792482:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.792495:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966803.792506:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783966803.792508:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff3800 from 4 10000000:01000000:0.0:1783966803.792511:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966803.792544:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.792552:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.792573:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966803.792597:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.792655:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966803.792696:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d1e12840 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.792977:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842048 00000100:00100000:3.0:1783966803.792986:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842048 00000100:00100000:3.0:1783966803.793046:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783966803.793056:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587842048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966803.793076:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966803.793090:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066eb6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.793114:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.793124:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.793133:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0c00, rc 0) 00000100:00100000:3.0:1783966803.793172:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.793179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783966803.793221:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966803.793235:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.793243:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966803.793325:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.793349:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.793375:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.793388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842176 00000100:00100000:3.0:1783966803.793391:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842176 00000100:00100000:3.0:1783966803.793410:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783966803.793416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.793523:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.793531:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783966803.793558:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.793585:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.793619:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.793632:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.793642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842304 00000100:00100000:3.0:1783966803.793645:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842304 00000100:00100000:3.0:1783966803.793665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783966803.793671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.793738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.793744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783966803.793800:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.796610:0:10486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10486:1870624587842432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.796688:0:10486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.796736:0:10486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5558e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.796810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842432 00000100:00100000:3.0:1783966803.796817:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842432 00000100:00100000:3.0:1783966803.796865:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783966803.796874:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:10486:x1870624587842432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966803.796992:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:10486:x1870624587842432:12345-0@lo:502:llog_process_th.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.797000:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1783966803.797095:0:10486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10486:1870624587842432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.797121:0:10486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966803.797130:0:10486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.797133:0:10486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783966803.797139:0:10486:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05fcff3800 00000020:00000080:1.0:1783966803.797141:0:10486:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783966803.797222:0:10486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10486:1870624587842560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.797257:0:10486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.797271:0:10486:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5558e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.798553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842560 00000100:00100000:3.0:1783966803.798562:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842560 00000100:00100000:3.0:1783966803.798648:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783966803.798665:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:10486:x1870624587842560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966803.798800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:10486:x1870624587842560:12345-0@lo:502:llog_process_th.0 Request processed in 136us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.798808:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1783966803.802410:0:10486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10486:1870624587842560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.802458:0:10486:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966803.802467:0:10486:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.802470:0:10486:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783966803.802474:0:10486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783966803.805513:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783966803.805550:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783966803.805562:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.805575:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966803.805585:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783966803.805588:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f1a14000 from 4 10000000:01000000:0.0:1783966803.805591:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966803.805625:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.805633:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966803.805644:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966803.805670:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.805734:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966803.805803:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d93003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.805863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842688 00000100:00100000:1.0:1783966803.805871:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842688 00000100:00100000:1.0:1783966803.805923:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783966803.805932:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587842688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966803.805945:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966803.805957:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ec4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.805987:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.805997:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.806006:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ea00, rc 0) 00000100:00100000:1.0:1783966803.806047:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587842688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.806055:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783966803.806098:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966803.806111:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.806120:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966803.806173:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.806211:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.806227:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5558480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.806240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842816 00000100:00100000:1.0:1783966803.806243:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842816 00000100:00100000:1.0:1783966803.806545:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783966803.806553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587842816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.806655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587842816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.806670:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783966803.806700:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.806726:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.806757:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.806792:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5558480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.806803:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587842944 00000100:00100000:1.0:1783966803.806806:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587842944 00000100:00100000:1.0:1783966803.806824:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1783966803.806829:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587842944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.807414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587842944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 582us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.807423:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783966803.814538:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587842944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.820663:0:10489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10489:1870624587843072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966803.820749:0:10489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.820839:0:10489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966803.820914:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843072 00000100:00100000:0.0:1783966803.820921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843072 00000100:00100000:0.0:1783966803.820970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783966803.820980:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:10489:x1870624587843072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.821107:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:10489:x1870624587843072:12345-0@lo:502:llog_process_th.0 Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.821116:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783966803.821250:0:10489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10489:1870624587843072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966803.821276:0:10489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966803.821285:0:10489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966803.821287:0:10489:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783966803.821294:0:10489:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f1a14000 00000020:00000080:3.0:1783966803.821297:0:10489:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783966803.821379:0:10489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10489:1870624587843200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966803.821410:0:10489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.821423:0:10489:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966803.821682:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843200 00000100:00100000:0.0:1783966803.821688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843200 00000100:00100000:0.0:1783966803.821723:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783966803.821731:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:10489:x1870624587843200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.821842:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:10489:x1870624587843200:12345-0@lo:502:llog_process_th.0 Request processed in 111us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966803.821849:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783966803.823681:0:10489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10489:1870624587843200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966803.823721:0:10489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966803.823728:0:10489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966803.823730:0:10489:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783966803.823735:0:10489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783966803.824134:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783966803.824231:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966803.824243:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.824255:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966803.824265:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783966803.824268:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ed1cf800 from 4 10000000:01000000:1.0:1783966803.824271:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783966803.824304:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.824313:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.824331:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966803.824437:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966803.824499:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.824543:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.827296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843328 00000100:00100000:3.0:1783966803.827311:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843328 00000100:00100000:3.0:1783966803.827417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783966803.827427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587843328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966803.827444:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966803.827467:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066ed2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.827496:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.827508:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966803.827517:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1000, rc 0) 00000100:00100000:3.0:1783966803.827596:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587843328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.827603:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783966803.828371:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966803.828394:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966803.828413:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966803.828499:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966803.828543:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966803.828582:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5558780 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.832191:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843456 00000100:00100000:3.0:1783966803.832207:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843456 00000100:00100000:3.0:1783966803.832265:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783966803.832275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587843456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.832459:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587843456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.832467:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1783966803.832525:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.832578:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.832622:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966803.832652:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966803.832666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843584 00000100:00100000:3.0:1783966803.832670:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843584 00000100:00100000:3.0:1783966803.832707:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783966803.832714:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587843584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966803.832817:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587843584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966803.832823:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1783966803.832858:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587843584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966803.834712:0:10492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10492:1870624587843712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966803.834800:0:10492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966803.837215:0:10492:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.838840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843712 00000100:00100000:1.0:1783966803.838853:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843712 00000100:00100000:1.0:1783966803.838911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783966803.838922:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:10492:x1870624587843712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.839111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:10492:x1870624587843712:12345-0@lo:502:llog_process_th.0 Request processed in 190us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.839119:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783966803.839187:0:10492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10492:1870624587843712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.839222:0:10492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783966803.839232:0:10492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.839234:0:10492:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783966803.839241:0:10492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05ed1cf800 00000020:00000080:1.0:1783966803.839243:0:10492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783966803.839576:0:10492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10492:1870624587843840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.839622:0:10492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966803.839656:0:10492:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966803.840152:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843840 00000100:00100000:1.0:1783966803.840158:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843840 00000100:00100000:1.0:1783966803.840194:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783966803.840201:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:10492:x1870624587843840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966803.840303:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:10492:x1870624587843840:12345-0@lo:502:llog_process_th.0 Request processed in 102us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966803.840311:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1783966803.840380:0:10492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:10492:1870624587843840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783966803.840404:0:10492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783966803.840410:0:10492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783966803.840412:0:10492:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783966803.840416:0:10492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783966803.841611:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783966803.841654:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966803.841665:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966803.841678:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966804.022904:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966805.048438:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966805.249381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966805.249420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966805.249444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966805.249458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966805.249476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966805.249510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666176 00000100:00100000:0.0:1783966805.249519:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666176 00000100:00100000:0.0:1783966805.249585:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666048 00000100:00100000:0.0:1783966805.249588:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666048 00000100:00100000:0.0:1783966805.249608:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1783966805.249633:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666176:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966805.249704:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666176:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966805.249712:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1783966805.249728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:0.0:1783966805.249734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563666048:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966805.249753:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563666048:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 20us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966805.249759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:0.0:1783966805.249796:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666432 00000100:00100000:0.0:1783966805.249799:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666432 00000100:00100000:0.0:1783966805.249825:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666304 00000100:00100000:0.0:1783966805.249827:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666304 00000100:00100000:0.0:1783966805.249847:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783966805.249853:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666432:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966805.249877:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666432:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966805.249883:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783966805.249892:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1783966805.249898:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666304:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966805.249918:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563666304:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966805.249924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1783966805.250618:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563665920 00000100:00100000:1.0:1783966805.250625:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563665920 00000100:00100000:1.0:1783966805.250669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 273 00000100:00100000:1.0:1783966805.250678:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563665920:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966805.250720:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563665920:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 44us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966805.250727:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 273 00000100:00080000:3.0:1783966805.251074:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966805.251080:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966805.251083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966805.251085:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966805.372666:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966805.372691:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587843968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966805.372797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966805.372863:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587843968 00000100:00100000:0.0:1783966805.372871:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587843968 00000100:00100000:0.0:1783966805.372916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783966805.372924:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587843968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966805.372957:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966805.373000:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587843968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966805.373007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783966805.373064:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587843968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966806.081266:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966806.903302:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587844096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966806.903385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966806.903463:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966806.903488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966806.903523:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844096 00000100:00100000:0.0:1783966806.903530:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844096 00000100:00100000:0.0:1783966806.903814:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844224 00000100:00100000:0.0:1783966806.903818:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844224 00000100:00100000:0.0:1783966806.903838:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783966806.903846:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587844096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966806.903873:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966806.903914:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587844096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966806.903921:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783966806.903936:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783966806.903942:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587844224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966806.903971:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966806.904000:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587844224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966806.904007:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783966806.904041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6c000 x1870624587844224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966806.904059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587844224:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783966806.904085:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6fb80 x1870624587844096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966806.904096:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587844096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966806.904291:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587844480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966806.904334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783966806.904362:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966806.904366:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966806.904390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587844352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966806.904414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966806.904445:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844480 00000100:00100000:3.0:1783966806.904449:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844480 00000100:00100000:3.0:1783966806.904471:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844352 00000100:00100000:3.0:1783966806.904474:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844352 00000100:00100000:3.0:1783966806.904487:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783966806.904493:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587844480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966806.904502:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966806.904527:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587844480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.904532:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587844736:0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.904533:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783966806.904545:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783966806.904550:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587844352:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966806.904560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783966806.904566:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966806.904581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587845248:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.904621:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783966806.904627:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587844864:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.904670:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587845376:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.904714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844736 00000100:00100000:2.0:1783966806.904718:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844736 00000100:00100000:2.0:1783966806.904746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845248 00000100:00100000:2.0:1783966806.904749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845248 00000100:00100000:2.0:1783966806.904766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845376 00000100:00100000:2.0:1783966806.904785:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845376 00000100:00100000:2.0:1783966806.904801:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783966806.904821:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587844736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904858:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587844736:12345-0@lo:400:kworker.0 Request processed in 38us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.904871:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783966806.904897:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783966806.904904:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587845248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904934:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587845248:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.904940:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783966806.904956:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587844352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 405us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.904961:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783966806.904962:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783966806.904967:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587845376:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783966806.904975:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966806.904978:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966806.904981:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966806.904982:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966806.904991:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587844992:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.904994:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587845376:12345-0@lo:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.904999:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783966806.905013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.905018:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844864 00000100:00100000:2.0:1783966806.905021:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844864 00000100:00100000:3.0:1783966806.905028:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587845504:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905044:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783966806.905047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.905049:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587844864:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783966806.905063:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04a80 x1870624587844480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966806.905078:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587844480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966806.905078:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587844864:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.905083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783966806.905091:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783966806.905096:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587844608:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905101:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844992 00000100:00100000:2.0:1783966806.905104:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844992 00000100:00100000:2.0:1783966806.905117:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845504 00000100:00100000:2.0:1783966806.905120:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845504 00000100:00100000:2.0:1783966806.905140:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783966806.905145:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587844992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905174:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587844992:12345-0@lo:400:kworker.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.905189:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783966806.905206:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783966806.905211:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587845504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905240:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587845504:12345-0@lo:400:kworker.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.905245:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783966806.905276:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587844864:0@lo:400:kworker.0 00010000:00080000:2.0:1783966806.905286:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3734000 x1870624587845376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966806.905293:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587845376:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905301:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587844736:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.905323:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587845248:0@lo:400:kworker.0 00010000:00080000:2.0:1783966806.905385:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d05c00 x1870624587844352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966806.905397:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587844352:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783966806.905424:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966806.905882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966806.905953:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587845120:0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.905982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966806.906008:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587845632:0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.906029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966806.906043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845120 00000100:00100000:2.0:1783966806.906047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845120 00000100:00100000:3.0:1783966806.906053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587844992:0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.906062:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587845504:0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.906073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783966806.906079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587845120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.906089:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845632 00000100:00100000:3.0:1783966806.906092:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845632 00000100:00100000:2.0:1783966806.906116:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587845120:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966806.906123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1783966806.906156:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966806.906177:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587845120:0@lo:400:kworker.0 00000100:00100000:0.0:1783966806.906192:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587844608 00000100:00100000:0.0:1783966806.906196:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587844608 00000100:00100000:0.0:1783966806.906231:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1783966806.906238:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587844608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966806.906349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587844608:12345-0@lo:400:kworker.0 Request processed in 111us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966806.906355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783966806.906461:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783966806.906469:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587845632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966806.906481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587844608:0@lo:400:kworker.0 00000100:00100000:3.0:1783966806.906498:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587845632:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00010000:00080000:2.0:1783966806.906501:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3735c00 x1870624587845632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966806.906505:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966806.906509:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587845632:0@lo:400:kworker.0 00010000:00010000:2.0:1783966807.096897:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966807.416307:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966807.416332:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587845760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966807.416400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966807.416472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845760 00000100:00100000:2.0:1783966807.416479:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845760 00000100:00100000:2.0:1783966807.416534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783966807.416543:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587845760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966807.416586:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966807.416638:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587845760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966807.416646:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783966807.416815:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587845760:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966808.119027:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783966808.325266:0:10694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783966809.147002:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966810.167253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966810.382169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966810.382219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966810.382262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966810.382294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966810.382339:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966810.382356:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667072 00000100:00100000:3.0:1783966810.382374:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667072 00000100:00100000:0.0:1783966810.382382:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666816 00000100:00100000:0.0:1783966810.382409:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666816 00000100:00100000:3.0:1783966810.382472:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666944 00000100:00100000:3.0:1783966810.382479:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666944 00000100:00100000:0.0:1783966810.382482:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666688 00000100:00100000:0.0:1783966810.382488:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666688 00000100:00100000:3.0:1783966810.382526:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966810.382543:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563667072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966810.382545:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1783966810.382567:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563666816:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966810.382681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:2.0:1783966810.382690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563666688:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966810.382766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563666560 00000100:00100000:1.0:1783966810.382828:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563666560 00000100:00100000:3.0:1783966810.382840:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563667072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 298us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966810.382853:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966810.382887:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783966810.382895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 275 00000100:00100000:1.0:1783966810.382908:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2401:x1870624563666560:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966810.382919:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563666944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966810.383155:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563666816:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 590us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966810.383164:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00080000:0.0:1783966810.383233:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966810.383248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966810.383252:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966810.383254:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966810.393137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563666688:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 10437us (10830us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966810.393153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:1.0:1783966810.398052:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2401:x1870624563666560:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 15134us (15881us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966810.398067:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 275 00000100:00100000:3.0:1783966810.398468:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563666944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 15556us (16120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966810.398483:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:3.0:1783966810.487475:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966810.487510:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587845888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966810.487605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966810.487870:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587845888 00000100:00100000:0.0:1783966810.487881:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587845888 00000100:00100000:0.0:1783966810.487947:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783966810.487959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587845888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966810.488011:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966810.488067:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587845888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966810.488075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783966810.488178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587845888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783966811.196399:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966812.025152:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587846144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966812.025275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966812.025355:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966812.025362:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587846016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966812.025386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966812.025455:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846144 00000100:00100000:2.0:1783966812.025539:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846144 00000100:00100000:2.0:1783966812.025985:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846016 00000100:00100000:2.0:1783966812.025990:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846016 00000100:00100000:2.0:1783966812.026013:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783966812.026023:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587846144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966812.026061:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966812.026115:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587846144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.026121:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783966812.026154:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783966812.026159:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587846016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966812.026168:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966812.026187:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587846016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.026192:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783966812.026242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587846272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966812.026270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966812.026307:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846272 00000100:00100000:2.0:1783966812.026311:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846272 00000100:00100000:2.0:1783966812.026331:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783966812.026336:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587846272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966812.026359:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966812.026389:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587846272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.026394:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1783966812.026430:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d880 x1870624587846016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966812.026451:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587846016:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783966812.026539:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d07b80 x1870624587846144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966812.026553:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587846144:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783966812.026657:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3737100 x1870624587846272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966812.026669:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587846272:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783966812.027485:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966812.027491:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966812.027502:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587846400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966812.027554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027578:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587846912:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027618:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027639:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587847424:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027691:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783966812.027697:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587846784:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027739:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587847296:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027799:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587846528:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027855:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587847040:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027893:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587847552:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027919:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027936:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966812.027940:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587846656:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.027976:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587847168:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.027995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.028005:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587847680:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.028027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966812.028054:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846400 00000100:00100000:0.0:1783966812.028061:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846400 00000100:00100000:0.0:1783966812.028111:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783966812.028121:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587846400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966812.028141:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966812.028180:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587846400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966812.028193:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783966812.028232:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846912 00000100:00100000:0.0:1783966812.028236:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846912 00000100:00100000:0.0:1783966812.028259:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847424 00000100:00100000:0.0:1783966812.028262:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847424 00000100:00100000:0.0:1783966812.028274:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847296 00000100:00100000:0.0:1783966812.028276:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847296 00000100:00100000:0.0:1783966812.028288:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847552 00000100:00100000:0.0:1783966812.028291:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847552 00000100:00100000:0.0:1783966812.028301:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846656 00000100:00100000:0.0:1783966812.028303:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846656 00000100:00100000:0.0:1783966812.028313:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847168 00000100:00100000:0.0:1783966812.028314:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847168 00000100:00100000:0.0:1783966812.028327:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783966812.028333:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587846912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.028372:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587846912:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966812.028379:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783966812.028390:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783966812.028397:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587847424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.028421:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587847424:12345-0@lo:400:kworker.0 Request processed in 25us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966812.028426:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783966812.028435:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783966812.028440:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587847296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.028464:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587847296:12345-0@lo:400:kworker.0 Request processed in 23us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966812.028469:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783966812.028487:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783966812.028493:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587847552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.028527:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587847552:12345-0@lo:400:kworker.0 Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966812.028532:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783966812.028542:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783966812.028547:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966812.028570:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966812.028571:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587846656:12345-0@lo:400:kworker.0 Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966812.028584:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587847168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966812.028618:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587847168:12345-0@lo:400:kworker.0 Request processed in 37us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.028828:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846528 00000100:00100000:2.0:1783966812.028833:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846528 00000100:00100000:2.0:1783966812.028864:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783966812.028869:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587846528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966812.028907:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587846528:12345-0@lo:400:kworker.0 Request processed in 37us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.028914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783966812.028962:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587846784 00000100:00100000:2.0:1783966812.028966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587846784 00000100:00100000:2.0:1783966812.028981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847040 00000100:00100000:2.0:1783966812.028983:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847040 00000100:00100000:2.0:1783966812.028993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783966812.029007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587846784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966812.029038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587846784:12345-0@lo:400:kworker.0 Request processed in 34us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.029044:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783966812.029055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783966812.029059:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587847040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966812.029079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587847040:12345-0@lo:400:kworker.0 Request processed in 20us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.029084:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1783966812.029151:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966812.029156:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966812.029158:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966812.029168:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847680 00000100:00100000:2.0:1783966812.029171:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847680 00000100:00100000:2.0:1783966812.029193:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783966812.029198:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587847680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966812.029236:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587847680:12345-0@lo:400:kworker.0 Request processed in 37us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.029243:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783966812.032398:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783966812.032578:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587846784:0@lo:400:kworker.0 00010000:00080000:0.0:1783966812.033096:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708a80 x1870624587847296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966812.033110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587847296:0@lo:400:kworker.0 00010000:00080000:0.0:1783966812.033127:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6c380 x1870624587846400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966812.033146:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587846400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966812.033162:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587846912:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.033174:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587847424:0@lo:400:kworker.0 00000100:00100000:3.0:1783966812.033190:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966812.033254:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587846656:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.033268:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587847168:0@lo:400:kworker.0 00010000:00080000:0.0:1783966812.033288:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708e00 x1870624587847680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966812.033312:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587847680:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.033326:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587846528:0@lo:400:kworker.0 00000100:00100000:0.0:1783966812.033342:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587847040:0@lo:400:kworker.0 00010000:00080000:0.0:1783966812.033355:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c370aa00 x1870624587847552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966812.033365:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587847552:0@lo:400:kworker.0 00010000:00010000:0.0:1783966812.218680:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966812.537561:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587847808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966812.537679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966812.537936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847808 00000100:00100000:2.0:1783966812.537947:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847808 00000100:00100000:2.0:1783966812.538008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783966812.538020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587847808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966812.538069:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966812.538141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587847808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966812.538149:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783966812.541517:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587847808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966813.239689:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966814.271287:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783966814.463627:0:10938:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing yml_node 00010000:00010000:2.0:1783966815.298409:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966815.503034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966815.503068:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966815.503100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966815.503125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966815.503231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966815.503281:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667584 00000100:00100000:1.0:1783966815.503294:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667584 00000100:00100000:1.0:1783966815.503368:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667712 00000100:00100000:1.0:1783966815.503372:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667712 00000100:00100000:1.0:1783966815.503397:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1783966815.503408:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563667584:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:1.0:1783966815.503456:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066deb 00000100:00080000:1.0:1783966815.503469:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a04c3695800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783966815.503532:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783966815.503744:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+2:2399:x1870624563667584:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 337us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966815.503753:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1783966815.503807:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783966815.503815:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563667712:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:1.0:1783966815.503845:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066df2 00000100:00080000:1.0:1783966815.503852:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf71800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783966815.503877:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1783966815.503953:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+2:2399:x1870624563667712:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 139us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966815.503960:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783966815.503987:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667200 00000100:00100000:1.0:1783966815.503990:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667200 00000100:00100000:1.0:1783966815.504021:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 277 00000100:00100000:1.0:1783966815.504028:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563667200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966815.504055:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563667200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966815.504061:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 277 00000100:00100000:1.0:1783966815.504096:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667456 00000100:00100000:1.0:1783966815.504100:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667456 00000100:00100000:1.0:1783966815.504130:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667328 00000100:00100000:1.0:1783966815.504132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667328 00000100:00100000:1.0:1783966815.504167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:1.0:1783966815.504175:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563667456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966815.504204:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563667456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966815.504210:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:1.0:1783966815.504222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:1.0:1783966815.504227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563667328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966815.504248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563667328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966815.504261:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00080000:1.0:1783966815.504283:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966815.504288:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966815.504290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966815.504292:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783966815.504370:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966815.504501:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966815.607263:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587847936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783966815.607370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966815.609388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587847936 00000100:00100000:3.0:1783966815.609405:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587847936 00000100:00100000:3.0:1783966815.609477:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783966815.609490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587847936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966815.609539:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966815.612500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587847936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3000us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966815.612519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783966815.616035:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587847936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966816.311621:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966817.143989:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966817.144136:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966817.144230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.144332:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848064 00000100:00100000:2.0:1783966817.144341:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848064 00000100:00100000:3.0:1783966817.144363:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966817.144405:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783966817.144419:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848064:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966817.144448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1783966817.144452:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1783966817.144551:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3734380 x1870624587848064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966817.144573:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966817.144599:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 182us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.144612:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783966817.144617:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848192 00000100:00100000:3.0:1783966817.144625:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848192 00000100:00080000:1.0:1783966817.145040:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966817.145046:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966817.145054:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966817.145067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587848320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966817.145107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.145316:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587848832:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.145349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.145375:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587849344:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.145397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.145413:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587849856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966817.147718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848704:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.147801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.147852:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587849216:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.147881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.147906:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587849728:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.147932:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.147962:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783966817.147969:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587848576:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.148034:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587849088:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148054:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.148071:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587849600:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.148142:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848704 00000100:00100000:2.0:1783966817.148150:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848704 00000100:00100000:2.0:1783966817.148209:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966817.148221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148300:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848704:12345-0@lo:400:kworker.0 Request processed in 81us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148309:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966817.148353:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849344 00000100:00100000:2.0:1783966817.148358:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849344 00000100:00100000:2.0:1783966817.148404:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849728 00000100:00100000:2.0:1783966817.148407:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849728 00000100:00100000:2.0:1783966817.148427:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783966817.148446:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587849344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587849344:12345-0@lo:400:kworker.0 Request processed in 54us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148493:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783966817.148506:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783966817.148511:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587849728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148535:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587849728:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148540:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783966817.148569:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848832 00000100:00100000:2.0:1783966817.148573:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848832 00000100:00100000:2.0:1783966817.148589:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849216 00000100:00100000:2.0:1783966817.148591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849216 00000100:00100000:2.0:1783966817.148603:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848576 00000100:00100000:2.0:1783966817.148605:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848576 00000100:00100000:2.0:1783966817.148615:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849088 00000100:00100000:2.0:1783966817.148618:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849088 00000100:00100000:2.0:1783966817.148628:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849600 00000100:00100000:2.0:1783966817.148630:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849600 00000100:00100000:2.0:1783966817.148644:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966817.148649:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587848832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587848832:12345-0@lo:400:kworker.0 Request processed in 33us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148688:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966817.148701:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966817.148706:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587849216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148733:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587849216:12345-0@lo:400:kworker.0 Request processed in 26us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148739:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966817.148751:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783966817.148757:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148815:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587848576:12345-0@lo:400:kworker.0 Request processed in 58us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783966817.148834:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783966817.148840:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148866:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587849088:12345-0@lo:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783966817.148893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783966817.148898:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587849600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.148928:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587849600:12345-0@lo:400:kworker.0 Request processed in 31us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.148934:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783966817.148998:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587848576:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.149011:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587849088:0@lo:400:kworker.0 00010000:00080000:2.0:1783966817.149024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3728000 x1870624587849600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966817.149035:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587849600:0@lo:400:kworker.0 00000100:00100000:2.0:1783966817.149046:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848704:0@lo:400:kworker.0 00010000:00080000:2.0:1783966817.149056:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729c00 x1870624587849216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966817.149064:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587849216:0@lo:400:kworker.0 00010000:00080000:2.0:1783966817.149074:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729500 x1870624587849728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966817.149082:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587849728:0@lo:400:kworker.0 00000100:00080000:2.0:1783966817.149196:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966817.149201:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966817.149204:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783966817.149206:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966817.152327:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966817.161930:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848320 00000100:00100000:3.0:1783966817.161956:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848320 00000100:00100000:3.0:1783966817.162087:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783966817.162100:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966817.162159:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966817.163199:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783966817.163224:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587848320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966817.163253:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966817.163342:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587848320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (18234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966817.163350:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783966817.163626:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849856 00000100:00100000:0.0:1783966817.163633:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849856 00000100:00100000:1.0:1783966817.163879:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587848832:0@lo:400:kworker.0 00010000:00080000:1.0:1783966817.163908:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372a300 x1870624587849344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966817.163922:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587849344:0@lo:400:kworker.0 00000100:00100000:0.0:1783966817.163960:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783966817.163971:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587849856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966817.163984:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00002000:00000024:0.0:1783966817.164001:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966817.164007:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587848448:0@lo:400:kworker.0 00000100:00100000:0.0:1783966817.164063:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587849856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (11744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966817.164073:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783966817.164084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966817.164138:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587848960:0@lo:400:kworker.0 00000100:00100000:1.0:1783966817.164173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966817.164198:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1a27100 x1870624587848320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966817.164221:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587849472:0@lo:400:kworker.0 00000100:00100000:0.0:1783966817.164225:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587848320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966817.164258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966817.164301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372b480 x1870624587849856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966817.164320:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587849856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966817.164674:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587848192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2574us (20224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966817.164694:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1783966817.164745:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d07b80 x1870624587848192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966817.164763:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587848192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966817.165072:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849472 00000100:00100000:1.0:1783966817.165080:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849472 00000100:00100000:0.0:1783966817.165094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848960 00000100:00100000:0.0:1783966817.165104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848960 00000100:00100000:0.0:1783966817.165189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783966817.165202:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966817.165207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783966817.165216:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587848448 00000100:00100000:3.0:1783966817.165224:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587848448 00000100:00100000:1.0:1783966817.165225:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587849472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966817.165284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783966817.165297:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587848448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966817.165307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587849472:12345-0@lo:400:kworker.0 Request processed in 87us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966817.165315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783966817.165341:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587848448:12345-0@lo:400:kworker.0 Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966817.165350:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1783966817.165352:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966817.165378:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587848448:0@lo:400:kworker.0 00000100:00100000:0.0:1783966817.166047:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587848960:12345-0@lo:400:kworker.0 Request processed in 124us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966817.166059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783966817.169852:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587848960:0@lo:400:kworker.0 00000100:00100000:1.0:1783966817.169881:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587849472:0@lo:400:kworker.0 00010000:00010000:1.0:1783966817.336431:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966817.655282:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587849984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966817.655437:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966817.655838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587849984 00000100:00100000:2.0:1783966817.655847:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587849984 00000100:00100000:2.0:1783966817.655913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783966817.655924:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587849984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966817.655987:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966817.656055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587849984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966817.656063:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783966817.656897:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587849984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966818.359837:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966819.384190:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783966819.439268:0:11122:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:1.0:1783966820.408456:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966820.615434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966820.615493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966820.615530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966820.615582:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667840 00000100:00100000:3.0:1783966820.615595:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667840 00000100:00100000:3.0:1783966820.615665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 279 00000100:00100000:3.0:1783966820.615678:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563667840:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966820.615792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563667840:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966820.615801:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 279 00000100:00100000:2.0:1783966820.615954:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563667968 00000100:00100000:2.0:1783966820.615960:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563667968 00000100:00080000:3.0:1783966820.616001:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966820.616031:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668096 00000100:00100000:2.0:1783966820.616035:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668096 00000100:00100000:2.0:1783966820.616084:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1783966820.616093:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563667968:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:3.0:1783966820.616186:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966820.616359:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563667968:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 266us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966820.616367:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:2.0:1783966820.616403:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:2.0:1783966820.616411:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563668096:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966820.616443:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563668096:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966820.616449:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1783966820.728822:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966820.729100:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587850112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966820.729497:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966820.730570:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850112 00000100:00100000:2.0:1783966820.730582:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850112 00000100:00100000:2.0:1783966820.730661:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783966820.730674:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587850112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783966820.730724:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783966820.730844:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587850112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966820.730852:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783966820.731391:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587850112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966821.432866:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783966821.755368:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:1.0:1783966821.755377:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a04c3696000/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:0.0:1783966821.755478:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3696000/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-OST0000 00000020:00000080:0.0:1783966821.755529:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3695800 for lustre-OST0000 00000001:00100000:3.0:1783966821.758749:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:3.0:1783966821.758762:0:9512:0:(genops.c:906:class_export_put()) final put ffff9a05fcf77000/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:1.0:1783966821.758884:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcf77000/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-OST0001 00000020:00000080:1.0:1783966821.758954:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fcf71800 for lustre-OST0001 00000100:00100000:3.0:1783966822.262910:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587850240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966822.263001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.263320:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850240 00000100:00100000:0.0:1783966822.263327:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850240 00000100:00100000:0.0:1783966822.263382:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783966822.263392:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587850240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966822.263420:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966822.263476:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587850240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.263483:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783966822.263506:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587850368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966822.263532:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783966822.263571:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966822.263583:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850368 00000100:00100000:0.0:1783966822.263586:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850368 00000100:00100000:0.0:1783966822.263613:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783966822.263620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587850368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966822.263635:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966822.263666:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587850368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.263673:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1783966822.263685:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966822.263709:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708a80 x1870624587850368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.263727:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587850368:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783966822.263756:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04000 x1870624587850240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.263802:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587850240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966822.264165:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587850496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966822.264198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966822.264227:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850496 00000100:00100000:3.0:1783966822.264232:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850496 00000100:00100000:3.0:1783966822.264259:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783966822.264266:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587850496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966822.264277:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966822.264308:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587850496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966822.264314:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1783966822.264341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04000 x1870624587850496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966822.264354:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587850496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966822.266294:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587850624:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266373:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587851136:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266392:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587851648:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266434:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266453:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966822.266457:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587850752:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266501:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587851264:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266531:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587851776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266548:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.266572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850624 00000100:00100000:0.0:1783966822.266577:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850624 00000100:00100000:0.0:1783966822.266612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783966822.266618:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587850624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587850624:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.266661:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1783966822.266686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851136 00000100:00100000:0.0:1783966822.266689:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851136 00000100:00100000:0.0:1783966822.266709:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783966822.266714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587851136:12345-0@lo:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.266746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783966822.266759:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851648 00000100:00100000:0.0:1783966822.266762:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851648 00000100:00100000:0.0:1783966822.266807:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850752 00000100:00100000:0.0:1783966822.266810:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850752 00000100:00100000:0.0:1783966822.266830:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851264 00000100:00100000:0.0:1783966822.266833:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851264 00000100:00100000:0.0:1783966822.266848:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783966822.266854:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587851648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266883:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587851648:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.266889:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783966822.266901:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783966822.266906:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587850752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266932:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587850752:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.266938:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783966822.266947:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783966822.266953:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587851264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.266976:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587851264:12345-0@lo:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.266981:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783966822.267002:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851776 00000100:00100000:0.0:1783966822.267005:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851776 00000100:00100000:0.0:1783966822.267042:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783966822.267048:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587851776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.267073:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587851776:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.270660:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1783966822.270724:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966822.270729:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966822.270732:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966822.270741:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966822.270761:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587851008:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.270843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.270877:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587851520:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.270900:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.270923:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783966822.270930:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587850880:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.270954:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.270971:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587851392:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.270992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.271008:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587851904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966822.271043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966822.271079:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851904 00000100:00100000:0.0:1783966822.271087:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851904 00000100:00100000:0.0:1783966822.271133:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783966822.271140:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587851904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966822.271166:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966822.271206:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587851904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.271212:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783966822.271235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851008 00000100:00100000:0.0:1783966822.271240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851008 00000100:00100000:0.0:1783966822.271262:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851520 00000100:00100000:0.0:1783966822.271265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851520 00000100:00100000:0.0:1783966822.271286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587851392 00000100:00100000:0.0:1783966822.271288:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587851392 00000100:00100000:0.0:1783966822.271301:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783966822.271306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587851008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587851008:12345-0@lo:400:kworker.0 Request processed in 38us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.271350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783966822.271361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783966822.271366:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587851520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271392:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587851520:12345-0@lo:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.271398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783966822.271408:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783966822.271415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587851392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271438:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587851392:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.271444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1783966822.271465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966822.271467:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966822.271474:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587850880 00000100:00100000:0.0:1783966822.271478:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587850880 00000100:00100000:0.0:1783966822.271497:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783966822.271502:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271528:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587850880:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966822.271534:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783966822.271584:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587850752:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271597:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587851264:0@lo:400:kworker.0 00010000:00080000:0.0:1783966822.271610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d880 x1870624587851776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.271626:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587851776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271636:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587850624:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271646:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587851136:0@lo:400:kworker.0 00010000:00080000:0.0:1783966822.271656:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6ca80 x1870624587851648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.271663:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587851648:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587850880:0@lo:400:kworker.0 00010000:00080000:0.0:1783966822.271704:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d180 x1870624587851392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.271712:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587851392:0@lo:400:kworker.0 00010000:00080000:0.0:1783966822.271722:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372b480 x1870624587851904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966822.271735:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587851904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966822.271744:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587851008:0@lo:400:kworker.0 00000100:00100000:0.0:1783966822.271753:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587851520:0@lo:400:kworker.0 00000001:02000400:2.0:1783966822.307764:0:11219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:3.0:1783966822.457837:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966822.775596:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966822.775620:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587852032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966822.775684:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966822.775826:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852032 00000100:00100000:2.0:1783966822.775834:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852032 00000100:00100000:2.0:1783966822.775880:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783966822.775896:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587852032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966822.775926:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966822.775978:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587852032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966822.775984:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783966822.776164:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587852032:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966823.479120:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966824.506284:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783966825.085046:0:11317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:0.0:1783966825.527156:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966825.732529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966825.732580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966825.732626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668352 00000100:00100000:0.0:1783966825.732637:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668352 00000100:00100000:1.0:1783966825.732670:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668224 00000100:00100000:1.0:1783966825.732676:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668224 00000100:00100000:0.0:1783966825.732719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:1.0:1783966825.732721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:0.0:1783966825.732734:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563668352:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966825.732735:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2403:x1870624563668224:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:2.0:1783966825.732863:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966825.732865:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2403:x1870624563668224:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 133us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966825.732875:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:3.0:1783966825.732904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966825.732929:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668480 00000100:00100000:1.0:1783966825.732933:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668480 00000100:00100000:1.0:1783966825.733003:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:1.0:1783966825.733011:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563668480:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966825.733109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563668352:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 379us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966825.733118:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00080000:0.0:1783966825.736906:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966825.746191:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563668480:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 13157us (13265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966825.746229:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:2.0:1783966825.848181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587852160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966825.848276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966825.848475:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852160 00000100:00100000:3.0:1783966825.848485:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852160 00000100:00100000:3.0:1783966825.848557:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783966825.848567:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587852160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966825.848609:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966825.855556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587852160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6974us (7263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966825.855576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783966825.860894:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587852160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966826.552448:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783966826.887540:0:11365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 14:20:24 EDT 2026 00000100:00100000:1.0:1783966827.383063:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587852416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966827.383153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966827.383279:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587852672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966827.383328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966827.383364:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783966827.383371:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587852288:0@lo:400:kworker.0 00000100:00100000:2.0:1783966827.383410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966827.383436:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587852800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966827.383460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966827.383491:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852416 00000100:00100000:2.0:1783966827.383498:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852416 00000100:00100000:2.0:1783966827.383549:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852672 00000100:00100000:2.0:1783966827.383567:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852672 00000100:00100000:2.0:1783966827.383586:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852800 00000100:00100000:2.0:1783966827.383588:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852800 00000100:00100000:2.0:1783966827.383603:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783966827.383611:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587852416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966827.383642:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966827.384375:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587853312:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384430:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587853824:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384478:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783966827.384484:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587853184:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384525:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587853696:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384591:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587852544:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384615:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384633:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587852928:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384666:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587853440:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384682:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384695:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587853952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966827.384710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384720:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783966827.384725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587853056:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384765:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587853568:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.384811:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966827.384928:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853952 00000100:00100000:0.0:1783966827.384934:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853952 00000100:00100000:0.0:1783966827.384972:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783966827.384983:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587852672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966827.385001:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966827.385034:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587852672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385041:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783966827.385066:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783966827.385072:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587852800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966827.385100:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966827.385124:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587852800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385129:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783966827.385140:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783966827.385145:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587853952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966827.385152:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966827.385174:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587853952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385180:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783966827.385197:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966827.385200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966827.385225:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853312 00000100:00100000:0.0:1783966827.385234:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853312 00000100:00100000:0.0:1783966827.385257:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853696 00000100:00100000:0.0:1783966827.385259:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853696 00000100:00100000:0.0:1783966827.385278:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852544 00000100:00100000:0.0:1783966827.385281:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852544 00000100:00100000:0.0:1783966827.385290:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853440 00000100:00100000:0.0:1783966827.385292:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853440 00000100:00100000:0.0:1783966827.385300:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853056 00000100:00100000:0.0:1783966827.385302:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853056 00000100:00100000:0.0:1783966827.385415:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853568 00000100:00100000:0.0:1783966827.385419:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853568 00000100:00100000:0.0:1783966827.385438:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966827.385444:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587853312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385482:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587853312:12345-0@lo:400:kworker.0 Request processed in 37us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385488:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966827.385499:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783966827.385504:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587853696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385528:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587853696:12345-0@lo:400:kworker.0 Request processed in 24us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385533:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783966827.385543:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783966827.385549:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587852544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385573:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587852544:12345-0@lo:400:kworker.0 Request processed in 25us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385578:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783966827.385588:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783966827.385593:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385624:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587853440:12345-0@lo:400:kworker.0 Request processed in 31us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385630:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783966827.385639:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966827.385644:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587853056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385661:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587853056:12345-0@lo:400:kworker.0 Request processed in 17us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385666:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966827.385674:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783966827.385678:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587853568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385696:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587853568:12345-0@lo:400:kworker.0 Request processed in 17us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385701:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783966827.385715:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853824 00000100:00100000:0.0:1783966827.385718:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853824 00000100:00100000:0.0:1783966827.385740:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783966827.385745:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587853824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385766:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587853824:12345-0@lo:400:kworker.0 Request processed in 21us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385791:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783966827.385805:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587853184 00000100:00100000:0.0:1783966827.385808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587853184 00000100:00100000:0.0:1783966827.385821:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852928 00000100:00100000:0.0:1783966827.385823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852928 00000100:00100000:0.0:1783966827.385832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966827.385837:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587853184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587853184:12345-0@lo:400:kworker.0 Request processed in 33us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385876:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966827.385885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783966827.385893:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587852928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.385930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587852928:12345-0@lo:400:kworker.0 Request processed in 27us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.385936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783966827.386001:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587853184:0@lo:400:kworker.0 00010000:00080000:0.0:1783966827.386021:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95c00 x1870624587853696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966827.386031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587853696:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.386044:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587853312:0@lo:400:kworker.0 00010000:00080000:0.0:1783966827.386053:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96d80 x1870624587853824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966827.386061:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587853824:0@lo:400:kworker.0 00000100:00080000:0.0:1783966827.386085:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966827.387816:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966827.387866:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587853056:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.387881:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587853568:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.387892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587852544:0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.387939:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587852928:0@lo:400:kworker.0 00010000:00080000:0.0:1783966827.387971:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d94000 x1870624587853440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966827.387982:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587853440:0@lo:400:kworker.0 00010000:00080000:0.0:1783966827.387994:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d500 x1870624587853952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966827.388036:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587853952:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783966827.390762:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729c00 x1870624587852800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966827.390893:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587852800:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783966827.390938:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274a680 x1870624587852672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966827.390953:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587852672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966827.391052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587852288 00000100:00100000:0.0:1783966827.391068:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587852288 00000100:00100000:0.0:1783966827.391152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783966827.391164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587852288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966827.391263:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587852288:12345-0@lo:400:kworker.0 Request processed in 102us (7851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966827.391272:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1783966827.391306:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587852288:0@lo:400:kworker.0 00000100:00100000:2.0:1783966827.392865:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587852416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9245us (9704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966827.392879:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1783966827.392990:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dce00 x1870624587852416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966827.393122:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587852416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783966827.575308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966827.905988:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587854080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966827.906089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966827.906421:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854080 00000100:00100000:1.0:1783966827.906431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854080 00000100:00100000:1.0:1783966827.906497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783966827.906508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587854080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966827.906563:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966827.906627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587854080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966827.906636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783966827.906694:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587854080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783966828.602345:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966829.635373:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966830.646985:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966830.848672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966830.848728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966830.848925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966830.848960:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668736 00000100:00100000:0.0:1783966830.848971:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668736 00000100:00100000:0.0:1783966830.849043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668864 00000100:00100000:0.0:1783966830.849046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668864 00000100:00100000:0.0:1783966830.849071:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1783966830.849082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563668736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966830.849201:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563668736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 119us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966830.849211:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1783966830.849240:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:0.0:1783966830.849248:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563668864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966830.849281:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563668864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966830.849288:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00080000:0.0:1783966830.849308:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966830.849313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966830.850938:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668608 00000100:00100000:3.0:1783966830.850951:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668608 00000100:00100000:3.0:1783966830.851017:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00100000:3.0:1783966830.851027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563668608:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966830.851128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563668608:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 103us (2399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966830.851137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00100000:2.0:1783966830.980370:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966830.980412:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587854208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966830.980507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966830.981229:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854208 00000100:00100000:0.0:1783966830.981241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854208 00000100:00100000:0.0:1783966830.981313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783966830.981324:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587854208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966830.981376:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966830.981449:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587854208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966830.981457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783966830.981530:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587854208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966831.671031:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966832.503464:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587854336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966832.503474:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587854464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966832.503607:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587854592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966832.507540:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587854720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966832.520080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.520187:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854464 00000100:00100000:0.0:1783966832.520196:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854464 00000100:00100000:0.0:1783966832.520252:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783966832.520263:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587854464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966832.520312:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966832.520370:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587854464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.520377:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783966832.520631:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966832.520672:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccce00 x1870624587854464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966832.520691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587854464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966832.520954:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587854976:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521076:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587855488:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521120:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587856000:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521180:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783966832.521185:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587855104:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521244:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587855616:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521312:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587856128:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.521333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.521368:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854976 00000100:00100000:0.0:1783966832.521373:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854976 00000100:00100000:0.0:1783966832.521398:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855488 00000100:00100000:0.0:1783966832.521402:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855488 00000100:00100000:0.0:1783966832.526021:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856000 00000100:00100000:0.0:1783966832.526035:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856000 00000100:00100000:0.0:1783966832.526058:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855616 00000100:00100000:0.0:1783966832.526061:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855616 00000100:00100000:0.0:1783966832.526088:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856128 00000100:00100000:0.0:1783966832.526091:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856128 00000100:00100000:0.0:1783966832.526126:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783966832.526143:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.526247:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587854976:12345-0@lo:400:kworker.0 Request processed in 106us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.526254:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783966832.526271:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783966832.526289:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587855488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.526321:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587855488:12345-0@lo:400:kworker.0 Request processed in 44us (5218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.526327:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783966832.526338:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783966832.526344:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587856000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.526373:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587856000:12345-0@lo:400:kworker.0 Request processed in 30us (5211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.526379:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783966832.526389:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783966832.526395:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587855616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.527945:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587855616:12345-0@lo:400:kworker.0 Request processed in 1543us (6644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.527957:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783966832.527984:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783966832.527996:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587856128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.528036:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587856128:12345-0@lo:400:kworker.0 Request processed in 44us (6702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.528042:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783966832.528104:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855104 00000100:00100000:0.0:1783966832.528111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855104 00000100:00100000:0.0:1783966832.528162:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783966832.528169:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587855104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.528205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587855104:12345-0@lo:400:kworker.0 Request processed in 37us (6979us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.528211:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1783966832.528233:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966832.528238:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966832.528273:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587855104:0@lo:400:kworker.0 00010000:00080000:0.0:1783966832.528301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccc380 x1870624587855616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966832.528312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587855616:0@lo:400:kworker.0 00010000:00080000:0.0:1783966832.528323:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccc000 x1870624587856128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966832.528332:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587856128:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.528342:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587854976:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.528353:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587855488:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.528364:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587856000:0@lo:400:kworker.0 00000100:00100000:1.0:1783966832.530854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966832.530949:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854592 00000100:00100000:1.0:1783966832.530958:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854592 00000100:00100000:1.0:1783966832.531013:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783966832.531026:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587854592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966832.531063:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966832.531113:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587854592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966832.531120:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1783966832.531139:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783966832.531183:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2748000 x1870624587854592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966832.531203:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587854592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966832.543558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966832.543762:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587854848:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.543838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.543920:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854336 00000100:00100000:0.0:1783966832.543929:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854336 00000100:00100000:0.0:1783966832.543983:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783966832.543993:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587854336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966832.544018:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966832.544077:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587854336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.544084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783966832.555004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.555109:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854720 00000100:00100000:0.0:1783966832.555120:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854720 00000100:00100000:0.0:1783966832.555178:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783966832.555188:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587854720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966832.555217:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966832.555270:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587854720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.555277:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783966832.556413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587854848 00000100:00100000:1.0:1783966832.556421:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587854848 00000100:00100000:1.0:1783966832.556456:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783966832.556464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587854848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.556596:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587855360:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.556648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966832.556680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855360 00000100:00100000:2.0:1783966832.556684:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855360 00000100:00100000:2.0:1783966832.556712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783966832.556718:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587855360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.556755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587855360:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966832.556788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783966832.557138:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587854848:12345-0@lo:400:kworker.0 Request processed in 673us (13299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966832.557151:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:1.0:1783966832.557700:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966832.557708:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966832.558903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587855360:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.558919:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587855872:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.559001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783966832.559057:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372a300 x1870624587854336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966832.559091:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587854336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966832.559150:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587854848:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.559162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783966832.559170:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587855232:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.559173:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855872 00000100:00100000:0.0:1783966832.559180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855872 00000100:00100000:2.0:1783966832.559197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966832.559228:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783966832.559237:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587855872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966832.559324:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855232 00000100:00100000:1.0:1783966832.559328:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855232 00000100:00100000:2.0:1783966832.559636:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587855744:0@lo:400:kworker.0 00000100:00100000:1.0:1783966832.559689:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783966832.559697:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587855232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.561046:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587855872:12345-0@lo:400:kworker.0 Request processed in 1807us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.561059:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783966832.561583:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966832.561620:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587856256:0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.561703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966832.561732:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587855744 00000100:00100000:2.0:1783966832.561738:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587855744 00000100:00100000:2.0:1783966832.561787:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856256 00000100:00100000:2.0:1783966832.561790:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856256 00000100:00100000:2.0:1783966832.561814:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966832.561832:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587855744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.561875:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587855744:12345-0@lo:400:kworker.0 Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966832.561882:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966832.561911:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966832.561916:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587856256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966832.561949:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587856256:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966832.561955:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783966832.562607:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccd880 x1870624587856256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966832.562623:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587856256:0@lo:400:kworker.0 00010000:00080000:2.0:1783966832.562642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3cce300 x1870624587855872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966832.562650:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587855872:0@lo:400:kworker.0 00010000:00080000:2.0:1783966832.562673:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccd180 x1870624587855744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966832.562681:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587855744:0@lo:400:kworker.0 00000100:00100000:0.0:1783966832.563034:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587855232:12345-0@lo:400:kworker.0 Request processed in 3336us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966832.563045:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783966832.566657:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587855232:0@lo:400:kworker.0 00010000:00080000:3.0:1783966832.568642:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dc700 x1870624587854720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966832.568668:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587854720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783966832.698680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966833.015032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587856384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966833.015108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966833.016871:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856384 00000100:00100000:1.0:1783966833.016886:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856384 00000100:00100000:1.0:1783966833.016964:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783966833.016975:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587856384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966833.017021:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966833.017139:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587856384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966833.017147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783966833.017197:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587856384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783966833.719765:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966834.743087:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966835.768713:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966835.971086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966835.973067:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563668992 00000100:00100000:3.0:1783966835.973079:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563668992 00000100:00100000:3.0:1783966835.973136:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 285 00000100:00100000:3.0:1783966835.973147:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563668992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966835.973225:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2400:x1870624563668992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966835.973233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 285 00000100:00100000:0.0:1783966835.981349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966835.981391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966835.981416:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669248 00000100:00100000:0.0:1783966835.981425:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669248 00000100:00100000:0.0:1783966835.981483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669120 00000100:00100000:0.0:1783966835.981486:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669120 00000100:00100000:0.0:1783966835.981518:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1783966835.981527:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563669248:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966835.981598:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563669248:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966835.981606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:0.0:1783966835.981622:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:0.0:1783966835.981628:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563669120:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966835.981650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563669120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966835.981657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00080000:3.0:1783966835.985151:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966835.985162:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966836.092710:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587856512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966836.092844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966836.092957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856512 00000100:00100000:3.0:1783966836.092965:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856512 00000100:00100000:3.0:1783966836.093012:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783966836.093022:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587856512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966836.093053:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966836.095222:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587856512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2192us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966836.095236:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783966836.100334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587856512:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966836.795817:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966837.624903:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966837.625173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.625253:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856640 00000100:00100000:0.0:1783966837.625261:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856640 00000100:00100000:0.0:1783966837.625331:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783966837.625342:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587856640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966837.625373:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966837.625883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966837.625897:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966837.625934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966837.625989:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856768 00000100:00100000:1.0:1783966837.625993:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856768 00000100:00100000:1.0:1783966837.626017:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783966837.626023:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587856768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783966837.626034:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966837.626077:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587856768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.626085:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783966837.626091:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:1.0:1783966837.626126:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56e9880 x1870624587856768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966837.626181:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587856896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966837.626213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966837.626220:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966837.626249:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587856896 00000100:00100000:1.0:1783966837.626253:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587856896 00000100:00100000:1.0:1783966837.626275:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783966837.626282:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587856896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966837.626299:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966837.626437:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587856640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1095us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.626453:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1783966837.626476:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966837.626481:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966837.626496:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587856896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 213us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.626498:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587857024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966837.626510:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783966837.626535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966837.626547:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274a300 x1870624587856896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966837.626562:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587856896:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1783966837.626603:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96d80 x1870624587856640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966837.626619:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966837.626640:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857024 00000100:00100000:0.0:1783966837.626643:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857024 00000100:00100000:0.0:1783966837.626685:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783966837.626692:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587857024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966837.626702:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966837.626741:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587857024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.626748:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1783966837.626791:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2ded80 x1870624587857024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966837.626806:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587857024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783966837.627321:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966837.627450:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587857152:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.627492:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.627534:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587857664:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.627562:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.627585:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587858176:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.628146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.628174:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783966837.628180:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587857536:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.628257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.628280:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587858048:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.629703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.629785:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587857408:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.629819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.629842:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587857920:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.629865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.629889:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783966837.629896:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587857280:0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.633304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857152 00000100:00100000:1.0:1783966837.633320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857152 00000100:00100000:1.0:1783966837.633376:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783966837.633393:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587857152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.633480:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587857152:12345-0@lo:400:kworker.0 Request processed in 96us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.633488:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1783966837.634219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.634262:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587857792:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.634305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966837.634339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857664 00000100:00100000:0.0:1783966837.634344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857664 00000100:00100000:0.0:1783966837.634372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857408 00000100:00100000:0.0:1783966837.634375:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857408 00000100:00100000:0.0:1783966837.634401:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783966837.634418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587857664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.634458:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587857664:12345-0@lo:400:kworker.0 Request processed in 50us (6896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.634465:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783966837.634479:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783966837.634485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587857408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.634516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587857408:12345-0@lo:400:kworker.0 Request processed in 31us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.634521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783966837.634538:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858176 00000100:00100000:0.0:1783966837.634542:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858176 00000100:00100000:0.0:1783966837.634588:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857536 00000100:00100000:0.0:1783966837.634591:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857536 00000100:00100000:0.0:1783966837.634601:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858048 00000100:00100000:0.0:1783966837.634603:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858048 00000100:00100000:0.0:1783966837.634630:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857920 00000100:00100000:0.0:1783966837.634633:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857920 00000100:00100000:0.0:1783966837.634644:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857280 00000100:00100000:0.0:1783966837.634647:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857280 00000100:00100000:0.0:1783966837.634656:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587857792 00000100:00100000:0.0:1783966837.634658:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587857792 00000100:00100000:0.0:1783966837.634671:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783966837.634677:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587858176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.634709:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587858176:12345-0@lo:400:kworker.0 Request processed in 33us (6566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966837.634715:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783966837.634795:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783966837.634803:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.634850:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587857536:12345-0@lo:400:kworker.0 Request processed in 47us (6592us total) trans 0 rc 0/0 00000100:00080000:3.0:1783966837.634856:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966837.634857:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1783966837.634864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966837.634879:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783966837.634887:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.635082:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587858048:12345-0@lo:400:kworker.0 Request processed in 196us (5382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.635088:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783966837.635100:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783966837.635106:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587857920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.635134:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587857920:12345-0@lo:400:kworker.0 Request processed in 28us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.635140:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783966837.635150:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966837.635155:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587857280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.635180:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587857280:12345-0@lo:400:kworker.0 Request processed in 26us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.635187:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966837.635198:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783966837.635204:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966837.635233:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587857792:12345-0@lo:400:kworker.0 Request processed in 30us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966837.635240:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783966837.637308:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587857536:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587858048:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637345:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587857152:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637355:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587857664:0@lo:400:kworker.0 00010000:00080000:0.0:1783966837.637370:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccf480 x1870624587858176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966837.637380:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587858176:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637836:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587857280:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637849:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587857792:0@lo:400:kworker.0 00000100:00100000:0.0:1783966837.637860:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587857408:0@lo:400:kworker.0 00010000:00080000:0.0:1783966837.637898:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccd880 x1870624587857920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966837.638052:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587857920:0@lo:400:kworker.0 00010000:00010000:2.0:1783966837.815195:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966838.136011:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966838.136034:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587858304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966838.136099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966838.136158:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858304 00000100:00100000:3.0:1783966838.136165:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858304 00000100:00100000:3.0:1783966838.136208:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783966838.136216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587858304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966838.136249:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966838.136292:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587858304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966838.136299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783966838.136353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587858304:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966838.839357:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966839.863429:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966840.887510:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966841.116010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966841.116069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966841.116105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966841.116143:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669504 00000100:00100000:0.0:1783966841.116155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669504 00000100:00100000:0.0:1783966841.116228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669632 00000100:00100000:0.0:1783966841.116232:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669632 00000100:00100000:0.0:1783966841.116271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:0.0:1783966841.116283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563669504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966841.116383:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563669504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966841.116393:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:0.0:1783966841.116412:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:0.0:1783966841.116418:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563669632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966841.116445:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563669632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966841.116451:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00080000:0.0:1783966841.116468:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966841.116473:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966841.120103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669376 00000100:00100000:3.0:1783966841.120123:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669376 00000100:00100000:3.0:1783966841.120217:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 287 00000100:00100000:3.0:1783966841.120230:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563669376:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966841.120337:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563669376:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 110us (4267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966841.120345:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 287 00000100:00100000:1.0:1783966841.211035:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587858432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783966841.211149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966841.211409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858432 00000100:00100000:0.0:1783966841.211420:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858432 00000100:00100000:0.0:1783966841.211495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783966841.211507:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587858432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966841.211562:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966841.211622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587858432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966841.211630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783966841.211816:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587858432:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966841.917018:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966842.744464:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966842.744497:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587858560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966842.744592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966842.744683:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858560 00000100:00100000:0.0:1783966842.744693:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858560 00000100:00100000:0.0:1783966842.744824:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783966842.744837:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587858560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966842.744877:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966842.744931:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587858560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.744940:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1783966842.744967:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966842.745033:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587858816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966842.745062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966842.745094:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587858688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966842.745118:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966842.745160:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57abb80 x1870624587858560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966842.745183:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587858560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966842.745209:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858816 00000100:00100000:0.0:1783966842.745231:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858816 00000100:00100000:0.0:1783966842.745255:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858688 00000100:00100000:0.0:1783966842.745257:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858688 00000100:00100000:0.0:1783966842.745273:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966842.745280:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587858816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966842.745362:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966842.745396:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587858816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.745403:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783966842.745416:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783966842.745422:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587858688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966842.745439:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966842.745468:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587858688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.745475:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1783966842.745490:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966842.745492:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966842.745507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab100 x1870624587858816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966842.745521:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587858816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966842.745531:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966842.745536:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587858944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966842.745559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966842.745599:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab480 x1870624587858688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966842.745611:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587858688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966842.745670:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966842.745676:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587859072:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.745684:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587858944 00000100:00100000:2.0:1783966842.745688:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587858944 00000100:00100000:0.0:1783966842.745709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966842.745718:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783966842.745724:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587858944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966842.745735:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966842.745742:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859072 00000100:00100000:0.0:1783966842.745746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859072 00000100:00100000:2.0:1783966842.745784:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587858944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.745786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783966842.745791:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783966842.745793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587859072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966842.745834:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587859072:12345-0@lo:400:kworker.0 Request processed in 42us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.745841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:0.0:1783966842.745871:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966842.745886:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587859072:0@lo:400:kworker.0 00010000:00080000:0.0:1783966842.745886:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56e9c00 x1870624587858944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966842.745899:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587858944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966842.745948:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587859328:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.745963:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587859200:0@lo:400:kworker.0 00000100:00100000:0.0:1783966842.745975:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966842.745990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966842.751504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859328 00000100:00100000:0.0:1783966842.751527:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859328 00000100:00100000:0.0:1783966842.751617:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783966842.751639:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587859328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966842.751765:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587859328:12345-0@lo:400:kworker.0 Request processed in 139us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.751788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783966842.751818:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859200 00000100:00100000:0.0:1783966842.751823:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859200 00000100:00100000:0.0:1783966842.751852:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783966842.751876:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587859200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966842.751926:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587859200:12345-0@lo:400:kworker.0 Request processed in 51us (5934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966842.751933:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783966842.752491:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587859840:0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966842.752617:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587859328:0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783966842.752658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587859456:0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966842.752701:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587859968:0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752722:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966842.752749:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859840 00000100:00100000:3.0:1783966842.752753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859840 00000100:00100000:3.0:1783966842.752820:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859456 00000100:00100000:3.0:1783966842.752824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859456 00000100:00100000:3.0:1783966842.752840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859968 00000100:00100000:3.0:1783966842.752843:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859968 00000100:00100000:3.0:1783966842.752859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783966842.752866:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587859840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752906:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587859840:12345-0@lo:400:kworker.0 Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966842.752913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783966842.752946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783966842.752952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587859456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.752978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587859456:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966842.752985:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783966842.752997:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783966842.753003:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587859968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.753028:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587859968:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966842.753041:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1783966842.753077:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966842.753081:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966842.753104:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587859456:0@lo:400:kworker.0 00000100:00100000:3.0:1783966842.753113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587859968:0@lo:400:kworker.0 00010000:00080000:3.0:1783966842.753126:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab800 x1870624587859840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966842.753136:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587859840:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.753285:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587859712:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.753332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966842.753372:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587859200:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.753384:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783966842.753390:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587859584:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.753423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966842.753444:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587860096:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.753465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966842.753490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859584 00000100:00100000:2.0:1783966842.753495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859584 00000100:00100000:2.0:1783966842.753519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783966842.753526:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f15e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587859584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.754007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f15e3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587859584:12345-0@lo:400:kworker.0 Request processed in 480us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966842.754029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783966842.754488:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587859712 00000100:00100000:2.0:1783966842.754496:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587859712 00000100:00100000:2.0:1783966842.754539:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860096 00000100:00100000:2.0:1783966842.754610:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860096 00000100:00100000:2.0:1783966842.754650:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783966842.754659:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587859712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.754701:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587859712:12345-0@lo:400:kworker.0 Request processed in 44us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966842.754708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783966842.754720:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783966842.754725:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587860096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.754753:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587860096:12345-0@lo:400:kworker.0 Request processed in 28us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966842.754760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783966842.754825:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587859584:0@lo:400:kworker.0 00010000:00080000:2.0:1783966842.754839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab480 x1870624587860096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966842.754849:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587860096:0@lo:400:kworker.0 00000100:00100000:2.0:1783966842.754861:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587859712:0@lo:400:kworker.0 00000100:00080000:3.0:1783966842.755405:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966842.755411:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783966842.939881:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966843.255066:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966843.255096:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587860224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966843.255191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966843.256627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860224 00000100:00100000:3.0:1783966843.256641:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860224 00000100:00100000:3.0:1783966843.256712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783966843.256724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587860224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966843.256790:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966843.256872:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587860224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966843.256881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783966843.256957:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587860224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966843.959787:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966844.983136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966846.008402:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966846.215505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.218853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.218906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.218943:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669888 00000100:00100000:0.0:1783966846.218953:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669888 00000100:00100000:3.0:1783966846.219095:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563669760 00000100:00100000:3.0:1783966846.219099:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563669760 00000100:00100000:3.0:1783966846.219154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 289 00000100:00100000:1.0:1783966846.219848:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670016 00000100:00100000:1.0:1783966846.219853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670016 00000100:00100000:1.0:1783966846.219905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:1.0:1783966846.219913:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563670016:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966846.220110:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563669760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966846.220399:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563670016:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 485us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966846.220409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00080000:1.0:1783966846.220435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966846.220633:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2402:x1870624563669760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1469us (5192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.220642:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 289 00000100:00100000:0.0:1783966846.220822:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:0.0:1783966846.220832:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563669888:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966846.220864:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563669888:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.220870:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00080000:1.0:1783966846.221256:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1783966846.288541:0:11995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:20:44 (1783966844) === 00000100:00100000:1.0:1783966846.328202:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966846.328233:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587860352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783966846.328310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966846.328692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860352 00000100:00100000:0.0:1783966846.328707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860352 00000100:00100000:0.0:1783966846.328816:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783966846.328833:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587860352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966846.328884:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966846.328987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587860352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.328995:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783966846.329050:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587860352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966846.725831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.725950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670144 00000100:00100000:3.0:1783966846.725963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670144 00000100:00100000:3.0:1783966846.726036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 290 00000100:00100000:3.0:1783966846.726048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:8720:x1870624563670144:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783966846.726070:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966846.726095:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b2f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.726133:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b2f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.726147:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b2f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.726158:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1c00, rc 0) 00000100:00100000:3.0:1783966846.726239:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670144:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 192us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.726247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 290 00000100:00100000:0.0:1783966846.733923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966846.734099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670272 00000100:00100000:2.0:1783966846.734113:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670272 00000100:00100000:2.0:1783966846.734185:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00100000:2.0:1783966846.734198:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670272:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783966846.734449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670272:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 253us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.734458:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00100000:1.0:1783966846.740586:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.740835:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670400 00000100:00100000:0.0:1783966846.740866:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670400 00000100:00100000:0.0:1783966846.740940:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:0.0:1783966846.740954:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670400:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783966846.741182:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670400:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 231us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.741191:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:0.0:1783966846.754655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966846.755738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670528 00000100:00100000:2.0:1783966846.755755:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670528 00000100:00100000:2.0:1783966846.756123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:2.0:1783966846.756148:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670528:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783966846.758129:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670528:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 1979us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.758154:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:1.0:1783966846.773107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.773405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670656 00000100:00100000:3.0:1783966846.773418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670656 00000100:00100000:3.0:1783966846.773728:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:3.0:1783966846.773743:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670656:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783966846.774056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670656:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 316us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.774066:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:1.0:1783966846.777407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966846.777753:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670784 00000100:00100000:2.0:1783966846.777767:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670784 00000100:00100000:0.0:1783966846.778123:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:0.0:1783966846.778139:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670784:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783966846.778472:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8724:x1870624563670784:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 337us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.778481:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 295 00000100:00100000:1.0:1783966846.784604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.784901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563670912 00000100:00100000:3.0:1783966846.784914:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563670912 00000100:00100000:3.0:1783966846.784986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 296 00000100:00100000:3.0:1783966846.784997:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:8720:x1870624563670912:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783966846.785082:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966846.785109:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316066ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b60 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.785653:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316066ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b60 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.785670:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316066ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b60 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.785682:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0e00, rc 0) 00000100:00100000:3.0:1783966846.786077:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:8720:x1870624563670912:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 1080us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.786084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 296 00000100:00100000:1.0:1783966846.791196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.792467:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671040 00000100:00100000:0.0:1783966846.792481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671040 00000100:00100000:0.0:1783966846.792575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:0.0:1783966846.792587:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:8720:x1870624563671040:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783966846.792622:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783966846.793973:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783966846.793985:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783966846.793989:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783966846.793993:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783966846.793996:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783966846.797762:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:8720:x1870624563671040:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 5164us (6569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.798312:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 297 00000100:00100000:1.0:1783966846.801248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.801373:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671168 00000100:00100000:3.0:1783966846.801386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671168 00000100:00100000:3.0:1783966846.801515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 298 00000100:00100000:3.0:1783966846.801529:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:8720:x1870624563671168:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783966846.801560:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966846.801598:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b67 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.801636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.801649:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966846.801660:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:3.0:1783966846.801734:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8720:x1870624563671168:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 208us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.801742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 298 00000100:00100000:1.0:1783966846.804863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.804972:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671296 00000100:00100000:0.0:1783966846.805000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671296 00000100:00100000:0.0:1783966846.805070:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:0.0:1783966846.805083:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8720:x1870624563671296:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783966846.805286:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8720:x1870624563671296:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 205us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.805295:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 299 00000100:00100000:1.0:1783966846.807190:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.807375:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671424 00000100:00100000:3.0:1783966846.807386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671424 00000100:00100000:3.0:1783966846.807461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 300 00000100:00100000:3.0:1783966846.807474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8720:x1870624563671424:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783966846.808120:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8720:x1870624563671424:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 644us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.808132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 300 00000100:00100000:1.0:1783966846.818406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966846.818904:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671552 00000100:00100000:2.0:1783966846.818919:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671552 00000100:00100000:2.0:1783966846.819028:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:2.0:1783966846.819041:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8730:x1870624563671552:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783966846.819271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8730:x1870624563671552:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 232us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.819281:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:1.0:1783966846.823903:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966846.824165:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671680 00000100:00100000:2.0:1783966846.824178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671680 00000100:00100000:2.0:1783966846.824335:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00100000:2.0:1783966846.824348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8730:x1870624563671680:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783966846.824568:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:8730:x1870624563671680:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 222us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.824576:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00100000:1.0:1783966846.832204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966846.832272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.832450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671808 00000100:00100000:3.0:1783966846.832463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671808 00000100:00100000:3.0:1783966846.832516:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672064 00000100:00100000:3.0:1783966846.832519:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672064 00000100:00100000:3.0:1783966846.832543:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783966846.832562:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1870624563671808:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783966846.832603:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44@192.168.204.59@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1783966846.832651:0:6517:0:(genops.c:1406:class_connect()) connect: client d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44, cookie 0x9269c8b316066ef5 00000004:00100000:3.0:1783966846.832684:0:6517:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1783966846.832860:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a04c375f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966846.832944:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2399:x1870624563671808:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 381us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.832970:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783966846.833004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1783966846.833009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1870624563672064:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783966846.833025:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44@192.168.204.59@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1783966846.833047:0:6517:0:(genops.c:1406:class_connect()) connect: client d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44, cookie 0x9269c8b316066efc 00000004:00100000:3.0:1783966846.833061:0:6517:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1783966846.833817:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a04c375d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966846.833879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2399:x1870624563672064:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 866us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.833888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1783966846.836164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966846.836226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966846.843028:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672448 00000100:00100000:0.0:1783966846.843049:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672448 00000100:00100000:0.0:1783966846.843134:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672576 00000100:00100000:0.0:1783966846.843138:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672576 00000100:00100000:0.0:1783966846.843172:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1783966846.843185:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563672448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966846.843678:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:2.0:1783966846.843693:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563672576:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966846.843815:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563672576:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 126us (7597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966846.843823:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1783966846.844068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.844181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.844206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.844233:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672192 00000100:00100000:3.0:1783966846.844240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672192 00000100:00100000:3.0:1783966846.844278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563671936 00000100:00100000:3.0:1783966846.844281:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563671936 00000100:00100000:3.0:1783966846.844295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672320 00000100:00100000:3.0:1783966846.844298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672320 00000100:00100000:3.0:1783966846.844313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966846.844322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:0:x1870624563672192:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783966846.844356:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966846.844417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:0:x1870624563672192:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.844424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966846.844475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:3.0:1783966846.844481:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+7:0:x1870624563671936:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783966846.844499:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966846.844533:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+7:0:x1870624563671936:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.844539:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:3.0:1783966846.844562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1783966846.844569:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563672320:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783966846.844582:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966846.844604:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563672320:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.844610:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00080000:1.0:1783966846.844870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966846.844875:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966846.845335:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563672448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 2147us (9180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.845345:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:1.0:1783966846.856995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.857096:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672704 00000100:00100000:3.0:1783966846.857110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672704 00000100:00100000:3.0:1783966846.857182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1783966846.857195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563672704:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783966846.857318:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563672704:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966846.857327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1783966846.861255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.861305:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966846.861345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966846.861624:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672832 00000100:00100000:1.0:1783966846.861649:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672832 00000100:00100000:1.0:1783966846.861701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563672960 00000100:00100000:1.0:1783966846.861704:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563672960 00000100:00100000:1.0:1783966846.861729:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783966846.861739:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563672832:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783966846.861823:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44@192.168.204.59@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:1.0:1783966846.861862:0:8434:0:(genops.c:1406:class_connect()) connect: client d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44, cookie 0x9269c8b316066f03 00002000:00100000:1.0:1783966846.861878:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44/ffff9a05f5682800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783966846.861900:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1783966846.861994:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783966846.862033:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a05f5680800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966846.862114:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2399:x1870624563672832:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 376us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966846.862122:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783966846.862139:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1783966846.862143:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563672960:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783966846.862160:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44@192.168.204.59@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:1.0:1783966846.862190:0:8434:0:(genops.c:1406:class_connect()) connect: client d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44, cookie 0x9269c8b316066f0a 00002000:00100000:1.0:1783966846.862195:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44/ffff9a05f5683000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783966846.862206:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1783966846.862303:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783966846.862317:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a05f5682000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783966846.862341:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2399:x1870624563672960:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 196us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966846.862348:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783966846.863068:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673088 00000100:00100000:0.0:1783966846.863078:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673088 00000100:00100000:0.0:1783966846.863137:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1783966846.863147:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563673088:12345-192.168.204.59@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783966846.865796:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563673088:12345-192.168.204.59@tcp:900:mount.lustre.0 Request processed in 2621us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966846.865814:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1783966846.880237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966846.880403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673216 00000100:00100000:1.0:1783966846.880417:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673216 00000100:00100000:1.0:1783966846.880496:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:1.0:1783966846.880508:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563673216:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:1.0:1783966846.880647:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783966846.880763:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:8720:x1870624563673216:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 256us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966846.880817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00010000:00010000:0.0:1783966847.031934:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966847.863252:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587860864:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863446:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587861376:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863500:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587861888:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863562:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587862400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966847.863592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863627:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1783966847.863634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587860480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966847.863655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863673:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587860992:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863729:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587861504:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863802:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587862016:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863823:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863857:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587860608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966847.863881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.863882:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860864 00000100:00100000:3.0:1783966847.863896:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587861120:0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.863903:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860864 00000100:00100000:3.0:1783966847.863916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.863926:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587861632:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.863953:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861376 00000100:00100000:0.0:1783966847.863956:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861376 00000100:00100000:3.0:1783966847.863960:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587862144:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.863977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.863989:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861888 00000100:00100000:3.0:1783966847.863992:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783966847.863992:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861888 00000100:00100000:3.0:1783966847.864004:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587860736:0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864005:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861504 00000100:00100000:0.0:1783966847.864007:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861504 00000100:00100000:0.0:1783966847.864018:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862016 00000100:00100000:0.0:1783966847.864021:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862016 00000100:00100000:0.0:1783966847.864030:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861120 00000100:00100000:0.0:1783966847.864033:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861120 00000100:00100000:3.0:1783966847.864034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.864047:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783966847.864057:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587861248:0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864057:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587860864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.864078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.864093:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587861760:0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.864110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.864119:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587860864:12345-0@lo:400:kworker.0 Request processed in 63us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.864124:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587862272:0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864127:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783966847.864140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966847.864146:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783966847.864152:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587861376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966847.864166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783966847.864174:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587861888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864198:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587861376:12345-0@lo:400:kworker.0 Request processed in 46us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.864199:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587861888:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966847.864204:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783966847.864347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783966847.864351:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587862528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966847.864367:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783966847.864376:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587861504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.864389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966847.864418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587861504:12345-0@lo:400:kworker.0 Request processed in 44us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966847.864418:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783966847.864425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783966847.864426:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587862016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.864435:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860992 00000100:00100000:1.0:1783966847.864441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860992 00000100:00100000:3.0:1783966847.864447:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783966847.864454:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864457:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587862016:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966847.864463:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783966847.864476:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861248 00000100:00100000:1.0:1783966847.864479:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861248 00000100:00100000:3.0:1783966847.864492:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587861120:12345-0@lo:400:kworker.0 Request processed in 37us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966847.864492:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783966847.864500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.864543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587860992:12345-0@lo:400:kworker.0 Request processed in 44us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.865264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783966847.865317:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862400 00000100:00100000:3.0:1783966847.865323:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862400 00000100:00100000:3.0:1783966847.865365:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860480 00000100:00100000:3.0:1783966847.865369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860480 00000100:00100000:3.0:1783966847.865384:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860608 00000100:00100000:3.0:1783966847.865387:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860608 00000100:00100000:3.0:1783966847.865402:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862528 00000100:00100000:3.0:1783966847.865405:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862528 00000100:00100000:3.0:1783966847.865420:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783966847.865427:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587862400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966847.865452:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966847.865508:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587862400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.865514:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783966847.865542:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783966847.865550:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587860480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966847.865562:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966847.865590:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587860480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.865595:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783966847.865608:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966847.865613:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587860608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783966847.865622:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966847.865645:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587860608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966847.865650:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783966847.865680:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783966847.865685:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587862528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966847.865694:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966847.867460:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861632 00000100:00100000:1.0:1783966847.867477:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861632 00000100:00100000:1.0:1783966847.867601:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862144 00000100:00100000:1.0:1783966847.867605:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862144 00000100:00100000:1.0:1783966847.867617:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587861760 00000100:00100000:1.0:1783966847.867629:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587861760 00000100:00100000:1.0:1783966847.867642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862272 00000100:00100000:1.0:1783966847.867645:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862272 00000100:00100000:1.0:1783966847.867665:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783966847.867674:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587861632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.867765:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587861632:12345-0@lo:400:kworker.0 Request processed in 93us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.867856:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783966847.867882:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783966847.867889:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587862144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.867919:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587862144:12345-0@lo:400:kworker.0 Request processed in 31us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.867924:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783966847.867933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966847.867938:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587861760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.867958:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587861760:12345-0@lo:400:kworker.0 Request processed in 21us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.867963:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966847.867971:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783966847.867976:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587862272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.867997:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587862272:12345-0@lo:400:kworker.0 Request processed in 21us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.868001:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1783966847.868017:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966847.868022:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966847.868026:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966847.868029:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966847.869811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783966847.869869:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783966847.869888:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587861248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966847.869992:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587861248:12345-0@lo:400:kworker.0 Request processed in 113us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966847.869999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783966847.872459:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587861248:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.872489:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d97480 x1870624587861760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.872501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587861760:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.873259:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3cce680 x1870624587862272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.873272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587862272:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.873282:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57aa680 x1870624587860608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.873302:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587860608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966847.873317:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587861120:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.873329:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95f80 x1870624587861632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.873337:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587861632:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.873349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96d80 x1870624587862144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.873357:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587862144:0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.873436:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587860736 00000100:00100000:1.0:1783966847.873445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587860736 00000100:00100000:1.0:1783966847.873889:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1783966847.873903:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587860736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.874028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587860736:12345-0@lo:400:kworker.0 Request processed in 128us (9992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.874056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1783966847.874191:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587860736:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.874230:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a9880 x1870624587860480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.874244:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587860480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966847.874257:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587860992:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.874269:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95500 x1870624587861504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.874276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587861504:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.874287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96300 x1870624587862016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.874294:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587862016:0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.874307:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587860864:0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.874320:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587861376:0@lo:400:kworker.0 00000100:00100000:1.0:1783966847.874332:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587861888:0@lo:400:kworker.0 00010000:00080000:1.0:1783966847.874344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dca80 x1870624587862400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.874354:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587862400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966847.874464:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587862528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8777us (10074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966847.874486:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1783966847.874614:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274b480 x1870624587862528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966847.874629:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587862528:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783966848.056370:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966848.381405:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587862656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966848.381531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966848.381707:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862656 00000100:00100000:0.0:1783966848.381719:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862656 00000100:00100000:0.0:1783966848.381808:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783966848.381821:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587862656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783966848.381881:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783966848.381954:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587862656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966848.381964:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783966848.382001:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587862656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966849.079166:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966850.110519:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966851.127020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966851.447272:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587862784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966851.447367:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966851.447566:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862784 00000100:00100000:0.0:1783966851.447575:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862784 00000100:00100000:0.0:1783966851.447644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966851.447654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587862784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966851.447692:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966851.447755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587862784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966851.447763:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783966851.447994:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587862784:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966852.151191:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966852.359527:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966852.359575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966852.359673:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673344 00000100:00100000:2.0:1783966852.359683:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673344 00000100:00100000:2.0:1783966852.359739:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 304 00000100:00100000:2.0:1783966852.359749:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563673344:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966852.359841:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563673344:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 94us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966852.359849:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 304 00000100:00100000:3.0:1783966852.360098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966852.366602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966852.366732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966852.366789:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674112 00000100:00100000:1.0:1783966852.366799:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674112 00000100:00100000:1.0:1783966852.367231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1783966852.367243:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563674112:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966852.367319:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563674112:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 79us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966852.367326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00080000:1.0:1783966852.367355:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966852.367938:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673600 00000100:00100000:0.0:1783966852.367954:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673600 00000100:00100000:0.0:1783966852.368010:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673856 00000100:00100000:0.0:1783966852.368014:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673856 00000100:00100000:0.0:1783966852.368057:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:0.0:1783966852.368076:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563673600:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966852.368122:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563673600:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 58us (8546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966852.368129:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:0.0:1783966852.368143:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:0.0:1783966852.368151:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673856:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966852.368177:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673856:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (8080us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966852.368184:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00080000:0.0:1783966852.368201:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966852.373411:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673472 00000100:00100000:2.0:1783966852.373429:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673472 00000100:00100000:3.0:1783966852.373721:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966852.373764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966852.373808:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673728 00000100:00100000:2.0:1783966852.373812:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673728 00000100:00100000:3.0:1783966852.373813:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:3.0:1783966852.373823:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563673472:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:1.0:1783966852.373870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966852.373884:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563673984 00000100:00100000:1.0:1783966852.373888:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563673984 00000100:00100000:3.0:1783966852.373899:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563673472:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 77us (7167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966852.373907:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:1.0:1783966852.373918:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783966852.373924:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673984:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966852.373953:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673984:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966852.373959:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1783966852.375143:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:2.0:1783966852.375154:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673728:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966852.375221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2401:x1870624563673728:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 69us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966852.375229:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00080000:1.0:1783966852.375380:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966852.984012:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587862912:0@lo:400:kworker.0 00000100:00100000:0.0:1783966852.984012:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587863040:0@lo:400:kworker.0 00000001:02000400:3.0:1783966852.987678:0:12188:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1783966852.996105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1783966852.996339:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000100:00100000:0.0:1783966852.997145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966852.997601:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587863552:0@lo:400:kworker.0 00000100:00100000:0.0:1783966852.998244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966852.998283:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587864064:0@lo:400:kworker.0 00000100:00100000:0.0:1783966852.998306:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966852.998342:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587864576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966852.998369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966852.998425:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587863296:0@lo:400:kworker.0 00000100:00100000:0.0:1783966852.998458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966852.998480:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587863808:0@lo:400:kworker.0 00000100:00100000:0.0:1783966852.999996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.000037:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587864320:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.000059:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.000085:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783966853.000092:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587863168:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.000117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.000135:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587863680:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.000157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.000185:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587864192:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.000204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.000331:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587864704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966853.000357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966853.000530:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863040 00000100:00100000:2.0:1783966853.000540:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863040 00000100:00100000:1.0:1783966853.000577:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863552 00000100:00100000:1.0:1783966853.000593:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863552 00000100:00100000:2.0:1783966853.000605:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864064 00000100:00100000:2.0:1783966853.000611:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864064 00000100:00100000:1.0:1783966853.000635:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863296 00000100:00100000:2.0:1783966853.000640:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863680 00000100:00100000:1.0:1783966853.000641:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863296 00000100:00100000:2.0:1783966853.000645:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863680 00000100:00100000:1.0:1783966853.000665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864192 00000100:00100000:1.0:1783966853.000670:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864192 00000100:00100000:2.0:1783966853.000675:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783966853.000687:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587863040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966853.000698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783966853.000708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587863552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.000749:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587863040:12345-0@lo:400:kworker.0 Request processed in 64us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.000751:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783966853.000765:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587864064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.000948:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587864064:12345-0@lo:400:kworker.0 Request processed in 187us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001034:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783966853.001042:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783966853.001061:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783966853.001068:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783966853.001073:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587863296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.001081:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.001121:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587863296:12345-0@lo:400:kworker.0 Request processed in 51us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.001129:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587863680:12345-0@lo:400:kworker.0 Request processed in 49us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001134:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783966853.001142:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783966853.001159:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783966853.001170:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.001182:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864576 00000100:00100000:0.0:1783966853.001188:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864576 00000100:00100000:1.0:1783966853.001193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587863552:12345-0@lo:400:kworker.0 Request processed in 483us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966853.001203:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783966853.001212:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587864192:12345-0@lo:400:kworker.0 Request processed in 44us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001220:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1783966853.001227:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966853.001234:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966853.001237:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966853.001253:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966853.001265:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587864832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966853.001312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966853.001348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587862912 00000100:00100000:2.0:1783966853.001353:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587862912 00000100:00100000:0.0:1783966853.001360:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864704 00000100:00100000:0.0:1783966853.001373:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864704 00000100:00100000:2.0:1783966853.001384:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783966853.001393:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.001426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587862912:12345-0@lo:400:kworker.0 Request processed in 35us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001445:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783966853.001503:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587862912:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.001511:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587863424:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.001537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966853.001543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864832 00000100:00100000:1.0:1783966853.001549:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864832 00000100:00100000:0.0:1783966853.001566:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783966853.001569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863168 00000100:00100000:0.0:1783966853.001577:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587864576:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966853.001590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863168 00002000:00000024:0.0:1783966853.001603:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966853.001616:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863424 00000100:00100000:2.0:1783966853.001621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863424 00000100:00100000:2.0:1783966853.001635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783966853.001644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587863168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966853.001644:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783966853.001667:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587864704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783966853.001682:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966853.001702:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587863168:12345-0@lo:400:kworker.0 Request processed in 59us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.001708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587864576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001715:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783966853.001721:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783966853.001727:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587864704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.001734:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783966853.001739:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783966853.001748:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783966853.001749:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587863424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.001762:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587864832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966853.001799:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966853.001834:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587864832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.001841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783966853.001991:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863808 00000100:00100000:0.0:1783966853.001996:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863808 00000100:00100000:0.0:1783966853.002024:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864320 00000100:00100000:0.0:1783966853.002027:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864320 00000100:00100000:0.0:1783966853.002047:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783966853.002055:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587863808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.002090:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587863808:12345-0@lo:400:kworker.0 Request processed in 36us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.002097:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783966853.002112:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783966853.002119:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.002152:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587864320:12345-0@lo:400:kworker.0 Request processed in 34us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.002159:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000001:00100000:1.0:1783966853.002299:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000100:00100000:0.0:1783966853.002318:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587863168:0@lo:400:kworker.0 00010000:00080000:0.0:1783966853.002338:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccc380 x1870624587863680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.002348:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587863424:12345-0@lo:400:kworker.0 Request processed in 601us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.002355:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587863680:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002368:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1783966853.002372:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0e00 x1870624587864192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966853.002383:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587864192:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002407:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587863424:0@lo:400:kworker.0 00010000:00080000:0.0:1783966853.002410:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274a680 x1870624587864704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.002417:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587863936:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.002441:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587864704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966853.002458:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587863296:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966853.002473:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3cce680 x1870624587863808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.002495:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587863936 00000100:00100000:2.0:1783966853.002499:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587863936 00000100:00100000:2.0:1783966853.002521:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783966853.002527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587863936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002555:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587863936:12345-0@lo:400:kworker.0 Request processed in 28us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.002562:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1783966853.002672:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0000 x1870624587863936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.002682:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587863936:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002690:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587864448:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966853.002730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587863808:0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.002736:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864448 00000100:00100000:2.0:1783966853.002741:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864448 00010000:00080000:0.0:1783966853.002754:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b0700 x1870624587864320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966853.002764:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587864320:0@lo:400:kworker.0 00000100:00080000:0.0:1783966853.002954:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966853.002959:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783966853.002980:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05cf064700 x1870624587864832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966853.002995:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587864832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966853.003076:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783966853.003086:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587864448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966853.003110:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587864960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966853.003127:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587864448:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966853.003135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783966853.003144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966853.003174:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587864960 00000100:00100000:2.0:1783966853.003178:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587864960 00010000:00080000:0.0:1783966853.003199:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274b480 x1870624587864576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.003208:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783966853.003218:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587864960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966853.003230:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966853.003279:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587864960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966853.003286:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1783966853.003313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05cf065880 x1870624587864960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966853.003327:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587864960:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783966853.003338:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b2680 x1870624587864448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966853.003349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587864576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966853.003350:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587864448:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.003380:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587863040:0@lo:400:kworker.0 00000100:00100000:0.0:1783966853.003472:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587863552:0@lo:400:kworker.0 00000001:00100000:1.0:1783966853.003493:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000100:00100000:0.0:1783966853.003562:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587864064:0@lo:400:kworker.0 00000001:00100000:1.0:1783966853.004119:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00010000:00010000:0.0:1783966853.177313:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966853.495072:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587865088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966853.495147:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966853.495254:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865088 00000100:00100000:1.0:1783966853.495263:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865088 00000100:00100000:1.0:1783966853.495319:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783966853.495338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587865088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966853.495387:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966853.495450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587865088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966853.495458:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783966853.495632:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587865088:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966854.200739:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966855.223082:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966856.247270:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966856.572355:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587865216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966856.572432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966856.572815:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865216 00000100:00100000:0.0:1783966856.572823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865216 00000100:00100000:0.0:1783966856.572870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966856.572880:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587865216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966856.572924:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966856.572984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587865216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966856.572992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966856.573037:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587865216:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966857.272558:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966857.490519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966857.490750:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674240 00000100:00100000:0.0:1783966857.490760:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674240 00000100:00100000:0.0:1783966857.490835:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 306 00000100:00100000:0.0:1783966857.490845:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563674240:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966857.491103:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674880 00000100:00100000:2.0:1783966857.491108:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674880 00000100:00100000:2.0:1783966857.491161:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675008 00000100:00100000:2.0:1783966857.491164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675008 00000100:00100000:3.0:1783966857.491165:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674368 00000100:00100000:3.0:1783966857.491172:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674368 00000100:00100000:2.0:1783966857.491186:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1783966857.491196:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966857.491211:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674624 00000100:00100000:3.0:1783966857.491216:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674624 00000100:00100000:3.0:1783966857.491244:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674496 00000100:00100000:3.0:1783966857.491247:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674496 00000100:00100000:3.0:1783966857.491259:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563674752 00000100:00100000:3.0:1783966857.491261:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563674752 00000100:00100000:3.0:1783966857.491432:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:3.0:1783966857.491438:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563674368:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966857.491532:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563674240:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 686us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966857.491533:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 336us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966857.491552:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 306 00000100:00100000:2.0:1783966857.491553:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1783966857.491577:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1783966857.491584:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563675008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966857.491608:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563675008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966857.491611:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:2.0:1783966857.491621:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1783966857.491626:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966857.491659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966857.491666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:0.0:1783966857.491682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1783966857.491689:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563674496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966857.491729:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563674496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966857.491737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1783966857.491749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:0.0:1783966857.491755:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966857.491820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563674752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 64us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966857.491827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00080000:0.0:1783966857.491852:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966857.491857:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966857.491859:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966857.491861:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966857.494471:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563674368:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 3021us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966857.494560:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1783966858.103031:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587865344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966858.103116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966858.103200:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865344 00000100:00100000:0.0:1783966858.103209:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865344 00000100:00100000:3.0:1783966858.104079:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966858.104127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104267:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865472 00000100:00100000:2.0:1783966858.104273:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865472 00000100:00100000:2.0:1783966858.104355:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783966858.104365:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587865472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966858.104396:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966858.104443:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587865472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966858.104451:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783966858.104564:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587865728:0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.104592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104611:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587866240:0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.104632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104648:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587866752:0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.104665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104680:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783966858.104685:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587865856:0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.104711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104733:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587866368:0@lo:400:kworker.0 00000100:00100000:0.0:1783966858.104744:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783966858.104756:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587865344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966858.104759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104795:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587866880:0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.104820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.104848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865728 00000100:00100000:2.0:1783966858.104852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865728 00000100:00100000:2.0:1783966858.104878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866240 00000100:00100000:2.0:1783966858.104881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866240 00002000:00000024:0.0:1783966858.104921:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966858.104960:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587865344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 206us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966858.104967:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783966858.105197:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866752 00000100:00100000:3.0:1783966858.105201:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866752 00000100:00100000:3.0:1783966858.105220:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866368 00000100:00100000:3.0:1783966858.105223:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866368 00000100:00100000:3.0:1783966858.105239:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783966858.105245:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587865728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105288:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587865728:12345-0@lo:400:kworker.0 Request processed in 43us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966858.105294:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783966858.105308:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783966858.105313:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587866752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105353:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587866752:12345-0@lo:400:kworker.0 Request processed in 40us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966858.105360:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783966858.105372:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783966858.105379:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587866368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105404:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587866368:12345-0@lo:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966858.105410:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783966858.105427:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587865600:0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966858.105493:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587866112:0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966858.105539:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587866624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.105561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966858.105581:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587867136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966858.105606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966858.105641:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866624 00000100:00100000:2.0:1783966858.105645:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866624 00000100:00100000:2.0:1783966858.105672:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783966858.105679:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587866240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966858.105723:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587866240:12345-0@lo:400:kworker.0 Request processed in 44us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966858.105730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783966858.107100:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783966858.107115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587866624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587866624:12345-0@lo:400:kworker.0 Request processed in 55us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1783966858.107216:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966858.107220:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966858.107222:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966858.107225:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966858.107251:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866880 00000100:00100000:1.0:1783966858.107255:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866880 00000100:00100000:1.0:1783966858.107285:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783966858.107289:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587866880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107311:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587866880:12345-0@lo:400:kworker.0 Request processed in 22us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107315:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783966858.107327:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865856 00000100:00100000:1.0:1783966858.107329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865856 00000100:00100000:1.0:1783966858.107357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866112 00000100:00100000:1.0:1783966858.107359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866112 00000100:00100000:1.0:1783966858.107368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783966858.107371:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587865856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587865856:12345-0@lo:400:kworker.0 Request processed in 32us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783966858.107415:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783966858.107419:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587866112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587866112:12345-0@lo:400:kworker.0 Request processed in 14us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107436:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1783966858.107446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783966858.107473:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c36b1500 x1870624587865344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.107488:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587865344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966858.107524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865600 00000100:00100000:1.0:1783966858.107528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865600 00000100:00100000:1.0:1783966858.107557:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1783966858.107564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587865600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587865600:12345-0@lo:400:kworker.0 Request processed in 30us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1783966858.107630:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587865984:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966858.107683:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587866496:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966858.107724:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587867008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966858.107798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587865984 00000100:00100000:1.0:1783966858.107802:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587865984 00000100:00100000:1.0:1783966858.107826:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783966858.107832:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587865984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107864:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587865984:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.107870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783966858.107902:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587865856:0@lo:400:kworker.0 00010000:00080000:1.0:1783966858.107930:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56e9c00 x1870624587866368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.107938:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587866368:0@lo:400:kworker.0 00010000:00080000:1.0:1783966858.107948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1a24e00 x1870624587866880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.107954:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587866880:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107964:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587865728:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.107975:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587866240:0@lo:400:kworker.0 00010000:00080000:1.0:1783966858.107986:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1a26300 x1870624587866752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.107993:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587866752:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.108035:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587866496 00000100:00100000:1.0:1783966858.108039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587866496 00000100:00100000:1.0:1783966858.108068:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783966858.108074:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587866496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.108121:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587866496:12345-0@lo:400:kworker.0 Request processed in 47us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966858.108127:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1783966858.108144:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966858.109184:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867136 00000100:00100000:0.0:1783966858.109192:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867136 00000100:00100000:0.0:1783966858.109225:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783966858.109233:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587867136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966858.109259:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966858.109311:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587867136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966858.109318:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1783966858.112544:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c274b480 x1870624587867136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966858.112572:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587867136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966858.112585:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587865600:0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.112597:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587866112:0@lo:400:kworker.0 00000100:00100000:3.0:1783966858.112609:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587866624:0@lo:400:kworker.0 00000100:00100000:1.0:1783966858.112733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966858.112812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf2a00 x1870624587865472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.112826:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587865472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966858.112849:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587865984:0@lo:400:kworker.0 00010000:00080000:1.0:1783966858.112858:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56e9880 x1870624587866496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966858.112867:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587866496:0@lo:400:kworker.0 00000100:00100000:0.0:1783966858.112974:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867008 00000100:00100000:0.0:1783966858.112981:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867008 00000100:00100000:0.0:1783966858.113031:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783966858.113040:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587867008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966858.113063:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966858.113179:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587867008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966858.113186:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1783966858.115044:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf3480 x1870624587867008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966858.115074:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587867008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783966858.295651:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966858.616888:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966858.618028:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587867264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966858.618108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966858.618271:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867264 00000100:00100000:0.0:1783966858.618280:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867264 00000100:00100000:0.0:1783966858.618378:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783966858.618389:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587867264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783966858.618429:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783966858.618484:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587867264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966858.618491:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783966858.618575:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587867264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966859.321665:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966860.343021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783966860.474686:0:12505:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783966860.475636:0:12505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783966861.367654:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966861.686976:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966861.687006:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587867392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966861.687084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966861.687192:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867392 00000100:00100000:0.0:1783966861.687214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867392 00000100:00100000:0.0:1783966861.687284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783966861.687294:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587867392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966861.687329:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966861.687378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587867392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966861.687385:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783966861.687426:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587867392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966862.391497:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966862.603476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966862.603542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.604103:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675136 00000100:00100000:1.0:1783966862.604115:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675136 00000100:00100000:1.0:1783966862.604200:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 308 00000100:00100000:1.0:1783966862.604213:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563675136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.604308:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563675136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 98us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.604318:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 308 00000100:00100000:1.0:1783966862.604358:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675264 00000100:00100000:1.0:1783966862.604362:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675264 00000100:00100000:1.0:1783966862.604419:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:1.0:1783966862.604427:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563675264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.604461:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563675264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.604475:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00080000:1.0:1783966862.604600:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966862.612853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.612889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.612911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.612939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.612966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966862.612995:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675776 00000100:00100000:1.0:1783966862.613005:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675776 00000100:00100000:1.0:1783966862.613061:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675904 00000100:00100000:1.0:1783966862.613065:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675904 00000100:00100000:1.0:1783966862.613088:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1783966862.613103:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675776:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.613173:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675776:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 74us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.613181:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1783966862.613198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1783966862.613205:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675904:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.613231:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675904:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.613238:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1783966862.613279:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675520 00000100:00100000:1.0:1783966862.613283:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675520 00000100:00100000:1.0:1783966862.613312:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675392 00000100:00100000:1.0:1783966862.613315:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675392 00000100:00100000:1.0:1783966862.613332:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563675648 00000100:00100000:1.0:1783966862.613346:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563675648 00000100:00100000:1.0:1783966862.613366:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:1.0:1783966862.613372:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.613404:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.613411:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:1.0:1783966862.613424:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:1.0:1783966862.613430:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563675392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.613455:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563675392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.613461:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:1.0:1783966862.613472:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:1.0:1783966862.613478:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966862.613501:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563675648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966862.613507:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00080000:1.0:1783966862.613531:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966862.613535:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966862.613538:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966862.613540:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1783966862.940005:0:12602:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783966862.940291:0:12602:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783966863.223040:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587867648:0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.223061:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587867520:0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.223199:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587867904:0@lo:400:kworker.0 00000100:00100000:3.0:1783966863.227321:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587867776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.229943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966863.234745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966863.234819:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867520 00000100:00100000:1.0:1783966863.234828:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867520 00000100:00100000:1.0:1783966863.234883:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783966863.234894:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587867520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.234974:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587867520:12345-0@lo:400:kworker.0 Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.234981:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1783966863.235113:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587867520:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235220:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867648 00000100:00100000:0.0:1783966863.235226:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867648 00000100:00100000:1.0:1783966863.235270:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587868032:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235278:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966863.235288:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587867648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235331:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587867648:12345-0@lo:400:kworker.0 Request processed in 46us (5395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.235340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.235345:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966863.235372:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868032 00000100:00100000:0.0:1783966863.235376:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868032 00000100:00100000:1.0:1783966863.235382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587868544:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235406:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783966863.235414:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.235424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.235458:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587868032:12345-0@lo:400:kworker.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.235466:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783966863.235468:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868544 00000100:00100000:1.0:1783966863.235474:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868544 00000100:00100000:0.0:1783966863.235502:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587867648:0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.235516:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783966863.235529:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587868160:0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.235532:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587868544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.235591:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868160 00000100:00100000:0.0:1783966863.235595:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868160 00000100:00100000:1.0:1783966863.235612:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587868544:12345-0@lo:400:kworker.0 Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.235622:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783966863.235626:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966863.235637:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587868160:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783966863.235656:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966863.235663:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966863.235685:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587868160:12345-0@lo:400:kworker.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.235690:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966863.235717:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587868160:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235724:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587868672:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.235749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966863.235789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4700 x1870624587868544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966863.235802:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587868544:0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.235809:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587869056:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.240454:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868672 00000100:00100000:0.0:1783966863.240471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868672 00000100:00100000:0.0:1783966863.240556:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783966863.240568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587868672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.240646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587868672:12345-0@lo:400:kworker.0 Request processed in 82us (4897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.240653:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1783966863.241065:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966863.241101:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587868672:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.241114:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587869184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966863.241154:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.241181:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869184 00000100:00100000:0.0:1783966863.241185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869184 00000100:00100000:0.0:1783966863.241235:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783966863.241256:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587869184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966863.241282:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966863.241326:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587869184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.241332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1783966863.241350:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966863.241368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3579880 x1870624587869184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966863.241385:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587869184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966863.241415:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966863.241422:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587869568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966863.241447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.241469:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869568 00000100:00100000:0.0:1783966863.241473:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869568 00000100:00100000:0.0:1783966863.241495:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783966863.241501:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587869568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966863.241516:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966863.241545:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587869568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.241551:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1783966863.241575:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7b80 x1870624587869568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966863.241588:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587869568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966863.241986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966863.242030:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587868032:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.242187:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869056 00000100:00100000:0.0:1783966863.242200:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869056 00000100:00100000:0.0:1783966863.242253:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783966863.242261:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587869056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.242304:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587869056:12345-0@lo:400:kworker.0 Request processed in 45us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.242311:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1783966863.242398:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4380 x1870624587869056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966863.242415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587869056:0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.242932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966863.242981:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587868416:0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.243015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966863.243148:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867904 00000100:00100000:0.0:1783966863.243154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867904 00000100:00100000:0.0:1783966863.243189:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783966863.243197:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587867904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.243237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587867904:12345-0@lo:400:kworker.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.243257:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783966863.243917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966863.244002:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587868288:0@lo:400:kworker.0 00000100:00100000:3.0:1783966863.244046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966863.244069:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587868800:0@lo:400:kworker.0 00000100:00100000:3.0:1783966863.244093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966863.244112:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587869312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966863.244218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587867776 00000100:00100000:0.0:1783966863.244224:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587867776 00000100:00100000:0.0:1783966863.244270:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783966863.244278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587867776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.245728:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868416 00000100:00100000:1.0:1783966863.245736:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868416 00000100:00100000:1.0:1783966863.245813:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783966863.245821:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587868416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.246196:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587868928:0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.246237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966863.246288:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868928 00000100:00100000:2.0:1783966863.246292:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868928 00000100:00100000:2.0:1783966863.246322:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783966863.246330:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587868928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.246378:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587868928:12345-0@lo:400:kworker.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966863.246385:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783966863.246426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf5c00 x1870624587868928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966863.246441:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587868928:0@lo:400:kworker.0 00000100:00100000:2.0:1783966863.246492:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587869440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966863.246517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966863.246541:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869440 00000100:00100000:2.0:1783966863.246544:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869440 00000100:00100000:2.0:1783966863.246567:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966863.246574:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624587869440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966863.246601:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966863.246635:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624587869440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966863.246821:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1783966863.246853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dfb80 x1870624587869440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966863.246869:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587869440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966863.246882:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587867904:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.249860:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587867776:12345-0@lo:400:kworker.0 Request processed in 5574us (5935us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.249876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783966863.249927:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868288 00000100:00100000:0.0:1783966863.249935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868288 00000100:00100000:0.0:1783966863.250002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587868800 00000100:00100000:0.0:1783966863.250006:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587868800 00000100:00100000:1.0:1783966863.250010:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587868416:12345-0@lo:400:kworker.0 Request processed in 4186us (6990us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.250024:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783966863.250040:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783966863.250050:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587868288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.250110:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587868288:12345-0@lo:400:kworker.0 Request processed in 61us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.250160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783966863.250171:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587868800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966863.250215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587868800:12345-0@lo:400:kworker.0 Request processed in 47us (6121us total) trans 0 rc 0/0 00010000:00080000:2.0:1783966863.250292:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf6a00 x1870624587868416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966863.250322:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587868416:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.250500:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783966863.250525:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1783966863.250525:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966863.250532:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966863.250537:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966863.253098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966863.253172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587867776:0@lo:400:kworker.0 00010000:00080000:3.0:1783966863.253188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf6680 x1870624587868288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966863.253198:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587868288:0@lo:400:kworker.0 00010000:00080000:3.0:1783966863.253209:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf4a80 x1870624587868800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966863.253217:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587868800:0@lo:400:kworker.0 00000100:00100000:0.0:1783966863.253461:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869312 00000100:00100000:0.0:1783966863.253469:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869312 00000100:00100000:0.0:1783966863.253567:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783966863.253576:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587869312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966863.253599:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966863.253661:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587869312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966863.253677:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1783966863.253741:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c357b800 x1870624587869312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966863.253756:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587869312:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783966863.415149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966863.739103:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587869696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966863.739250:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966863.739854:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869696 00000100:00100000:1.0:1783966863.739867:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869696 00000100:00100000:1.0:1783966863.740254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783966863.740267:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587869696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966863.740310:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966863.740410:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587869696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966863.740418:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783966863.740501:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587869696:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966864.442022:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783966865.393215:0:12699:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783966865.393443:0:12699:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783966865.463920:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966866.487064:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966866.807059:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587869824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966866.807152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966866.807419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869824 00000100:00100000:0.0:1783966866.807429:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869824 00000100:00100000:0.0:1783966866.807489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783966866.807499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587869824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966866.807533:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966866.807590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587869824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966866.807598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783966866.807679:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587869824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783966867.511097:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966867.726146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726316:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966867.726352:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676032 00000100:00100000:3.0:1783966867.726367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676032 00000100:00100000:3.0:1783966867.726422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 310 00000100:00100000:3.0:1783966867.726431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563676032:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966867.726511:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563676032:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.726519:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 310 00000100:00100000:3.0:1783966867.726552:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676160 00000100:00100000:3.0:1783966867.726556:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676160 00000100:00100000:3.0:1783966867.726589:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676288 00000100:00100000:3.0:1783966867.726592:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676288 00000100:00100000:3.0:1783966867.726604:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676544 00000100:00100000:3.0:1783966867.726606:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676544 00000100:00100000:3.0:1783966867.726619:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676416 00000100:00100000:3.0:1783966867.726621:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676416 00000100:00100000:3.0:1783966867.726634:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:3.0:1783966867.726639:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563676160:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966867.726670:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563676160:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.726678:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:3.0:1783966867.726717:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1783966867.726724:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563676288:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966867.726751:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563676288:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.726757:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1783966867.726787:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1783966867.726794:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563676544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966867.726819:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563676544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.726825:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1783966867.726843:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:3.0:1783966867.726849:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563676416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966867.726870:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563676416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.726877:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:3.0:1783966867.726900:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676672 00000100:00100000:3.0:1783966867.726903:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676672 00000100:00100000:3.0:1783966867.726931:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676800 00000100:00100000:3.0:1783966867.726934:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676800 00000100:00100000:3.0:1783966867.726954:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783966867.726960:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2399:x1870624563676672:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1783966867.727000:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066f03 00000100:00080000:3.0:1783966867.727009:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a05f5680800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783966867.727051:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783966867.727183:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+2:2399:x1870624563676672:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 223us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.727197:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783966867.727211:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783966867.727217:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2399:x1870624563676800:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1783966867.727228:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066f0a 00000100:00080000:3.0:1783966867.727234:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a05f5682000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783966867.727257:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783966867.727325:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+2:2399:x1870624563676800:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 107us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966867.727332:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00080000:3.0:1783966867.727488:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966867.727492:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966867.727495:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966867.727498:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783966867.727515:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966867.727521:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783966867.823435:0:12797:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783966867.823670:0:12797:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783966868.343311:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587869952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966868.343421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966868.343513:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587869952 00000100:00100000:2.0:1783966868.343521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587869952 00000100:00100000:2.0:1783966868.343574:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783966868.343584:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587869952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966868.343622:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966868.343687:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587869952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966868.343695:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1783966868.343724:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783966868.343747:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf6a00 x1870624587869952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966868.343782:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966868.343793:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587869952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966868.344053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.344256:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966868.344285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.344317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870080 00000100:00100000:3.0:1783966868.344322:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870080 00000100:00100000:3.0:1783966868.344351:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870208 00000100:00100000:3.0:1783966868.344354:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870208 00000100:00100000:3.0:1783966868.344371:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783966868.344386:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587870080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966868.344617:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783966868.344625:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587870208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966868.344644:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1783966868.344660:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966868.344725:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587870208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966868.344733:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783966868.344751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966868.344759:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587870336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966868.344817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966868.344842:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870336 00000100:00100000:2.0:1783966868.344845:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870336 00000100:00100000:2.0:1783966868.344865:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783966868.344872:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587870336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966868.344883:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966868.344911:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587870336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966868.344917:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1783966868.344958:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dca80 x1870624587870336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966868.344974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587870336:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783966868.345377:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d59880 x1870624587870208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966868.345396:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966868.345438:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587870080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1051us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.345448:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1783966868.345469:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966868.345473:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966868.346689:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966868.346706:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587870592:0@lo:400:kworker.0 00000100:00100000:0.0:1783966868.346757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966868.346848:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587870720:0@lo:400:kworker.0 00000100:00100000:0.0:1783966868.346900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966868.346932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870720 00000100:00100000:0.0:1783966868.346937:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870720 00000100:00100000:0.0:1783966868.346979:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783966868.346988:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587870720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966868.347042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587870720:12345-0@lo:400:kworker.0 Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966868.347056:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783966868.347515:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966868.347528:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587870464:0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.347566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966868.347606:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870464 00000100:00100000:1.0:1783966868.347611:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870464 00000100:00100000:1.0:1783966868.347642:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1783966868.347649:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587870464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.347687:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587870464:12345-0@lo:400:kworker.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966868.347694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1783966868.347737:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587870464:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.348338:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870592 00000100:00100000:3.0:1783966868.348344:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870592 00000100:00100000:3.0:1783966868.348397:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783966868.348405:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587870592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.348456:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587870592:12345-0@lo:400:kworker.0 Request processed in 53us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.348463:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783966868.349814:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587870848:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.349918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.349952:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587871360:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.349973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.349993:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783966868.349998:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587870976:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.350021:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.350037:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587871488:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.350059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783966868.351251:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7d5b480 x1870624587870080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966868.351276:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966868.351301:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587871104:0@lo:400:kworker.0 00000100:00100000:0.0:1783966868.351326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870976 00000100:00100000:0.0:1783966868.351334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870976 00000100:00100000:0.0:1783966868.351368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783966868.351378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587870976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966868.351439:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587870976:12345-0@lo:400:kworker.0 Request processed in 62us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966868.351447:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783966868.351470:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587871232:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.351759:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587870976:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.351798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587870848 00000100:00100000:3.0:1783966868.351802:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587870848 00000100:00100000:3.0:1783966868.351842:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871360 00000100:00100000:3.0:1783966868.351846:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871360 00000100:00100000:3.0:1783966868.351873:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871488 00000100:00100000:3.0:1783966868.351876:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871488 00000100:00100000:3.0:1783966868.351893:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783966868.351900:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587870848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.351939:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587870848:12345-0@lo:400:kworker.0 Request processed in 39us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.351945:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783966868.351959:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783966868.351965:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587871360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.351994:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587871360:12345-0@lo:400:kworker.0 Request processed in 29us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.352001:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783966868.352014:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783966868.352020:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.352049:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587871488:12345-0@lo:400:kworker.0 Request processed in 30us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.352056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783966868.352429:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966868.352470:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587870720:0@lo:400:kworker.0 00000100:00100000:2.0:1783966868.352485:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587870592:0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.352678:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871232 00000100:00100000:1.0:1783966868.352684:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871232 00000100:00100000:1.0:1783966868.352733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783966868.352740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587871232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.352820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587871232:12345-0@lo:400:kworker.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966868.352828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1783966868.352907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966868.352911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966868.352925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783966868.352981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d97b80 x1870624587871488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966868.352991:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587871488:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.353003:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587870848:0@lo:400:kworker.0 00000100:00100000:3.0:1783966868.353030:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587871360:0@lo:400:kworker.0 00010000:00080000:2.0:1783966868.353603:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2680a80 x1870624587871232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966868.353615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587871232:0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.353676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871104 00000100:00100000:1.0:1783966868.353682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871104 00000100:00100000:1.0:1783966868.353738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783966868.353746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587871104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966868.353819:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587871104:12345-0@lo:400:kworker.0 Request processed in 73us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966868.353826:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1783966868.353947:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966868.354036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587871104:0@lo:400:kworker.0 00010000:00010000:0.0:1783966868.535083:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966868.855068:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966868.855167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587871616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966868.855267:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966868.855420:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871616 00000100:00100000:3.0:1783966868.855428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871616 00000100:00100000:3.0:1783966868.855482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783966868.855492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587871616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966868.855529:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966868.855593:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587871616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966868.855601:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783966868.855645:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587871616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783966869.561604:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783966870.211253:0:12894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783966870.211525:0:12894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783966870.582906:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966871.611520:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966871.926961:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783966871.926986:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587871744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966871.927053:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966871.927380:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871744 00000100:00100000:0.0:1783966871.927389:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871744 00000100:00100000:3.0:1783966871.929278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783966871.929294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587871744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966871.929337:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966871.929639:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587871744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 350us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966871.929646:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783966871.929751:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587871744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966872.630986:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966872.836199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966872.836242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966872.836266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966872.836296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966872.836319:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966872.836347:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677184 00000100:00100000:3.0:1783966872.836356:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677184 00000100:00100000:3.0:1783966872.836411:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677440 00000100:00100000:3.0:1783966872.836415:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677440 00000100:00100000:3.0:1783966872.836428:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677056 00000100:00100000:3.0:1783966872.836431:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677056 00000100:00100000:3.0:1783966872.836441:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677312 00000100:00100000:3.0:1783966872.836443:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677312 00000100:00100000:3.0:1783966872.836458:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1783966872.836468:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563677184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966872.836539:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563677184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966872.836547:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1783966872.836563:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:3.0:1783966872.836569:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563677440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966872.836594:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563677440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966872.836600:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:3.0:1783966872.836610:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:3.0:1783966872.836616:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563677056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966872.836639:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563677056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966872.836645:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:3.0:1783966872.836656:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:3.0:1783966872.836669:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563677312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966872.836694:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563677312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966872.836701:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00080000:3.0:1783966872.836727:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966872.836730:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966872.838711:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563676928 00000100:00100000:2.0:1783966872.838857:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563676928 00000100:00100000:2.0:1783966872.838919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:2.0:1783966872.838929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563676928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966872.838993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563676928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 65us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966872.839000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:2.0:1783966873.463143:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587872000:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463166:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587872256:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.463221:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587871872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966873.463233:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587872128:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966873.463391:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587872896:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966873.463438:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587873152:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966873.463557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587873664:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966873.463614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872256 00000100:00100000:1.0:1783966873.463620:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872256 00000100:00100000:1.0:1783966873.463661:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783966873.463669:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587872256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587872256:12345-0@lo:400:kworker.0 Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.463724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783966873.463745:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872896 00000100:00100000:1.0:1783966873.463748:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872896 00000100:00100000:1.0:1783966873.463804:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783966873.463812:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587872896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.463843:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587872896:12345-0@lo:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.463848:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1783966873.463866:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966873.463894:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587872256:0@lo:400:kworker.0 00010000:00080000:1.0:1783966873.463919:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d97480 x1870624587872896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.464155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464179:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587872384:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464221:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464239:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873024:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.464316:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587872896:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.464358:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872384 00000100:00100000:1.0:1783966873.464362:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872384 00000100:00100000:1.0:1783966873.464388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783966873.464394:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587872384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.464427:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587872384:12345-0@lo:400:kworker.0 Request processed in 33us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.464433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783966873.464449:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873152 00000100:00100000:1.0:1783966873.464453:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873152 00000100:00100000:3.0:1783966873.464556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464574:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587873280:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464614:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966873.464635:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464656:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587872384:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464667:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966873.464673:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587873408:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.464720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873280 00000100:00100000:3.0:1783966873.464724:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873280 00000100:00100000:1.0:1783966873.464789:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873664 00000100:00100000:1.0:1783966873.464792:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873664 00000100:00100000:3.0:1783966873.464843:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873408 00000100:00100000:3.0:1783966873.464846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873408 00000100:00100000:3.0:1783966873.464861:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783966873.464875:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587873280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587873280:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.464914:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783966873.464938:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783966873.464944:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587873408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.464970:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587873408:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.464975:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783966873.464995:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873024 00000100:00100000:3.0:1783966873.464998:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873024 00000100:00100000:3.0:1783966873.465014:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783966873.465020:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587873152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.465200:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587873152:12345-0@lo:400:kworker.0 Request processed in 179us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.465206:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783966873.465218:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783966873.465224:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.465261:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873024:12345-0@lo:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.465267:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783966873.465288:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587871872 00000100:00100000:3.0:1783966873.465291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587871872 00000100:00100000:3.0:1783966873.465312:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873792 00000100:00100000:3.0:1783966873.465314:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873792 00000100:00100000:3.0:1783966873.465324:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783966873.465329:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587871872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783966873.465357:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966873.465390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587871872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.465396:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783966873.465408:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783966873.465413:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966873.465427:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966873.465451:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.465457:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1783966873.465579:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a9180 x1870624587873408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.465591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587873408:0@lo:400:kworker.0 00010000:00080000:3.0:1783966873.465601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f1a27b80 x1870624587873792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.465614:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873792:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783966873.465624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7b80 x1870624587871872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.465634:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587871872:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783966873.465643:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d97b80 x1870624587873024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.465649:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873024:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.465660:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587873280:0@lo:400:kworker.0 00010000:00080000:3.0:1783966873.465710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57aad80 x1870624587873152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.465719:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587873152:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.465802:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966873.465810:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966873.465844:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966873.465867:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873920 00000100:00100000:3.0:1783966873.465871:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873920 00000100:00100000:3.0:1783966873.465893:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783966873.465899:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966873.465910:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966873.466106:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587873920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 206us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.466112:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1783966873.466135:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dfb80 x1870624587873920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.466146:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587873920:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783966873.466189:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966873.466194:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966873.466196:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966873.466198:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966873.466399:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783966873.466407:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.466447:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587873664:12345-0@lo:400:kworker.0 Request processed in 43us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.466454:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1783966873.466600:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab480 x1870624587873664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966873.466609:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587873664:0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.468294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966873.468353:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587872768:0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.468400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966873.468435:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966873.468459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966873.468492:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587873536:0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.468514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966873.468559:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587873536 00000100:00100000:0.0:1783966873.468566:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587873536 00000100:00100000:0.0:1783966873.468607:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783966873.468615:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587873536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.468662:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587873536:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966873.468669:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783966873.468690:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872640 00000100:00100000:0.0:1783966873.468693:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872640 00000100:00100000:0.0:1783966873.468712:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783966873.468717:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587872640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966873.468732:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966873.468758:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587872640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966873.468764:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1783966873.468814:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7800 x1870624587872640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966873.468929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966873.468960:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587872512:0@lo:400:kworker.0 00000100:00100000:2.0:1783966873.468997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966873.469028:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872000 00000100:00100000:2.0:1783966873.469031:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872000 00000100:00100000:2.0:1783966873.469078:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783966873.469085:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587872000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966873.469119:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587872000:12345-0@lo:400:kworker.0 Request processed in 35us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966873.469125:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1783966873.469163:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587872000:0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.470314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872128 00000100:00100000:3.0:1783966873.470335:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872128 00000100:00100000:3.0:1783966873.470375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872768 00000100:00100000:3.0:1783966873.470377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872768 00000100:00100000:3.0:1783966873.470404:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783966873.470410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587872128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.470471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587872128:12345-0@lo:400:kworker.0 Request processed in 61us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.470478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1783966873.470493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783966873.470498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587872768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966873.470527:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587872768:12345-0@lo:400:kworker.0 Request processed in 29us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966873.470532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1783966873.470553:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966873.470744:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587872640:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783966873.470783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab100 x1870624587873536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966873.470808:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587873536:0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.470835:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587872128:0@lo:400:kworker.0 00000100:00100000:0.0:1783966873.470844:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587872768:0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.470919:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587872512 00000100:00100000:1.0:1783966873.470924:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587872512 00000100:00100000:1.0:1783966873.470961:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783966873.470968:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587872512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966873.471012:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587872512:12345-0@lo:400:kworker.0 Request processed in 44us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.471017:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783966873.471423:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587872512:0@lo:400:kworker.0 00010000:00010000:0.0:1783966873.655851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966873.975138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587874048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966873.975239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966873.976492:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874048 00000100:00100000:1.0:1783966873.976509:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874048 00000100:00100000:1.0:1783966873.976579:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783966873.976592:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587874048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966873.976634:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966873.976820:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587874048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966873.976829:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783966873.977740:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587874048:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1783966873.979678:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000020:00000080:2.0:1783966873.979688:0:9512:0:(genops.c:906:class_export_put()) final put ffff9a05f5683000/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000001:00100000:3.0:1783966873.979830:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000020:00000080:3.0:1783966873.979836:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a05f5682800/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000020:00000080:1.0:1783966873.981937:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5683000/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 for lustre-OST0001 00000020:00000080:1.0:1783966873.995536:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5682800/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 for lustre-OST0000 00000020:00000080:0.0:1783966873.995743:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f5682000 for lustre-OST0001 00000020:00000080:0.0:1783966873.995756:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f5680800 for lustre-OST0000 00000001:02000400:3.0:1783966874.675592:0:13040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783966874.678983:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966875.703232:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966876.727311:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966877.048431:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587874176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966877.048551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966877.048676:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874176 00000100:00100000:1.0:1783966877.048686:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874176 00000100:00100000:1.0:1783966877.048762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966877.048799:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587874176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966877.048856:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966877.048919:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587874176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966877.048927:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783966877.049128:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587874176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966877.767364:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966877.952347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966877.952383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966877.952411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966877.952435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966877.952444:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677824 00000100:00100000:2.0:1783966877.952458:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677824 00000100:00100000:3.0:1783966877.952479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966877.952505:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678080 00000100:00100000:3.0:1783966877.952509:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678080 00000100:00100000:2.0:1783966877.952529:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677696 00000100:00100000:2.0:1783966877.952534:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677696 00000100:00100000:3.0:1783966877.952536:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677952 00000100:00100000:3.0:1783966877.952540:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677952 00000100:00100000:2.0:1783966877.952565:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:2.0:1783966877.952578:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563677824:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966877.952611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563677568 00000100:00100000:1.0:1783966877.952617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563677568 00000100:00100000:1.0:1783966877.952665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 314 00000100:00100000:2.0:1783966877.952674:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563677824:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966877.952676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563677568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966877.953036:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563677568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 362us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966877.953044:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 314 00000100:00100000:3.0:1783966877.953314:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:2.0:1783966877.953324:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:3.0:1783966877.953326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563678080:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966877.953350:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:3.0:1783966877.953362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563678080:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966877.953372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:2.0:1783966877.953372:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563677696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966877.953392:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:3.0:1783966877.953400:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563677952:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966877.953431:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563677952:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 32us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966877.953437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00080000:3.0:1783966877.953461:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966877.953465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966877.953486:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563677696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 46us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966877.953495:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:1.0:1783966878.583494:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966878.583519:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587874304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966878.583608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.583817:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874304 00000100:00100000:2.0:1783966878.583827:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874304 00000100:00100000:2.0:1783966878.583897:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783966878.583907:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587874304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966878.583941:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966878.584006:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587874304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.584013:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783966878.584035:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783966878.584083:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7b80 x1870624587874304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966878.584100:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587874304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966878.585587:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966878.585606:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587874432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966878.585736:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.585802:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587874560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966878.585827:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.586423:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587875072:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.586450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.586469:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587875584:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.586489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.586507:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966878.586513:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587874688:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.586542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.586560:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587875200:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.586582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966878.586597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587875712:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.586785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966878.586795:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587876096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966878.586822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.586863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874688 00000100:00100000:2.0:1783966878.586869:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874688 00000100:00100000:2.0:1783966878.586912:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783966878.586921:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587874688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.586972:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587874688:12345-0@lo:400:kworker.0 Request processed in 52us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.586989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783966878.587022:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874432 00000100:00100000:2.0:1783966878.587026:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874432 00000100:00100000:2.0:1783966878.587051:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874560 00000100:00100000:2.0:1783966878.587055:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874560 00000100:00100000:2.0:1783966878.587079:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876096 00000100:00100000:2.0:1783966878.587081:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876096 00000100:00100000:2.0:1783966878.587093:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966878.587099:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587874432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966878.587258:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966878.587292:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587874432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.587298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966878.587310:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966878.587315:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587874560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966878.587325:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966878.587344:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587874560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 29us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.587349:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966878.587357:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783966878.587362:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587876096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966878.587371:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966878.587390:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587876096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.587396:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1783966878.587421:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966878.587429:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783966878.587453:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf7b80 x1870624587876096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966878.587469:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587876096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966878.587491:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587874944:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.587517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.587535:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587875456:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.587557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.587573:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587875968:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.587592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.587609:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783966878.587934:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875584 00000100:00100000:1.0:1783966878.587940:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875584 00000100:00100000:1.0:1783966878.587980:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875968 00000100:00100000:1.0:1783966878.587984:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875968 00000100:00100000:1.0:1783966878.588004:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783966878.588011:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587875584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966878.588047:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587875584:12345-0@lo:400:kworker.0 Request processed in 37us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966878.588053:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783966878.588075:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783966878.588081:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.588342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783966878.588374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96d80 x1870624587875584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966878.588384:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587875584:0@lo:400:kworker.0 00010000:00080000:0.0:1783966878.588394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf2a00 x1870624587874560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966878.588405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587874560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966878.588423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587874688:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.588502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875072 00000100:00100000:0.0:1783966878.588506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875072 00000100:00100000:0.0:1783966878.588533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875456 00000100:00100000:0.0:1783966878.588536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875456 00000100:00100000:0.0:1783966878.588559:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875712 00000100:00100000:0.0:1783966878.588562:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875712 00000100:00100000:0.0:1783966878.588576:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783966878.588582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587875072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966878.588691:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587875968:12345-0@lo:400:kworker.0 Request processed in 609us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966878.588698:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783966878.588723:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783966878.588730:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587875456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966878.588761:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587875456:12345-0@lo:400:kworker.0 Request processed in 32us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966878.588784:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783966878.588797:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783966878.588804:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587875712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.588875:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587874816:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.588903:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.588916:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587875328:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.588932:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966878.588941:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587875840:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.588971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783966878.588988:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a9180 x1870624587875456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966878.588997:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587875456:0@lo:400:kworker.0 00010000:00080000:2.0:1783966878.589006:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95c00 x1870624587875968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966878.589013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587875968:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.589031:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875200 00000100:00100000:2.0:1783966878.589043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875200 00000100:00100000:2.0:1783966878.589075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874944 00000100:00100000:2.0:1783966878.589078:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874944 00000100:00100000:2.0:1783966878.589094:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783966878.589100:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587875200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.589729:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587875072:12345-0@lo:400:kworker.0 Request processed in 1144us (3274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966878.589737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783966878.589753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587874816 00000100:00100000:0.0:1783966878.589757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587874816 00000100:00100000:0.0:1783966878.589787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875328 00000100:00100000:0.0:1783966878.589790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875328 00000100:00100000:0.0:1783966878.589803:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587875840 00000100:00100000:0.0:1783966878.589806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587875840 00000100:00100000:0.0:1783966878.589821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783966878.589826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587874816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.589878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587874816:12345-0@lo:400:kworker.0 Request processed in 52us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966878.589884:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783966878.589895:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783966878.589901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587875328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.589929:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587875328:12345-0@lo:400:kworker.0 Request processed in 29us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966878.589934:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783966878.589944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1783966878.589964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587875840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.589990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587875840:12345-0@lo:400:kworker.0 Request processed in 40us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966878.589996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:0.0:1783966878.590042:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf3480 x1870624587874432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966878.590059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587874432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966878.592750:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587875712:12345-0@lo:400:kworker.0 Request processed in 3940us (4401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966878.592761:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783966878.600092:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587875712:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.600174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587875072:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.601755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587875200:12345-0@lo:400:kworker.0 Request processed in 12647us (15164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.601783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783966878.601820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783966878.601844:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587874944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.601921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587874944:12345-0@lo:400:kworker.0 Request processed in 93us (14403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966878.601928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1783966878.601963:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966878.601969:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966878.602001:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587874816:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.602013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587875328:0@lo:400:kworker.0 00010000:00080000:2.0:1783966878.602027:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95180 x1870624587875840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966878.602038:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587875840:0@lo:400:kworker.0 00000100:00100000:2.0:1783966878.602049:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587874944:0@lo:400:kworker.0 00000100:00100000:0.0:1783966878.615649:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587875200:0@lo:400:kworker.0 00010000:00010000:2.0:1783966878.784491:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966879.095310:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966879.095336:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587876224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966879.095420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966879.095532:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876224 00000100:00100000:1.0:1783966879.095564:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876224 00000100:00100000:1.0:1783966879.095633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783966879.095644:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587876224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966879.095699:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966879.095757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587876224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966879.095764:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783966879.096278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587876224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966879.799199:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783966880.178271:0:13188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd19a64040 20000000:00000080:2.0:1783966880.178291:0:13188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05fcac1400 uarg=0000000000000000 20000000:01000000:2.0:1783966880.178407:0:13188:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783966880.178419:0:13188:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783966880.178424:0:13188:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783966880.179393:0:13189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1783966880.179754:0:13188:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783966880.193671:0:13188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783966880.198132:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198164:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198174:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198181:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198187:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198193:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198199:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198208:0:13188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198257:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198274:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 12 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.198312:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef208a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876352:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966880.198846:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198856:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.198867:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876480:0@lo:104: 00000100:00100000:0.0:1783966880.198911:0:13188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966880.198963:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.198972:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.198980:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876608:0@lo:104: 00000100:00100000:0.0:1783966880.199002:0:13188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966880.199034:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.199043:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.199051:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876736:0@lo:104: 00000100:00100000:0.0:1783966880.199071:0:13188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966880.199094:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.199116:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 23 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.199126:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876864:0@lo:104: 00000100:00100000:0.0:1783966880.199150:0:13188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966880.199169:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966880.199178:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.199188:0:13188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876992:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966880.199210:0:13188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605840 going to sleep for 11 seconds 00000100:00100000:1.0:1783966880.199386:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876480 00000100:00100000:1.0:1783966880.199394:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876480 00000100:00100000:1.0:1783966880.199431:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876608 00000100:00100000:1.0:1783966880.199433:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876608 00000100:00100000:1.0:1783966880.199442:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876736 00000100:00100000:1.0:1783966880.199444:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876736 00000100:00100000:1.0:1783966880.199452:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587876864 00000100:00100000:1.0:1783966880.199454:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587876864 00000100:00100000:1.0:1783966880.199466:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783966880.199476:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+6:13188:x1870624587876480:12345-0@lo:104: 00010000:00010000:1.0:1783966880.199489:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.199556:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783966880.199563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+6:13188:x1870624587876480:12345-0@lo:104: Request processed in 88us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966880.199570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783966880.199595:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783966880.199601:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:13188:x1870624587876608:12345-0@lo:104: 00010000:00010000:1.0:1783966880.199608:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.199655:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783966880.199661:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+5:13188:x1870624587876608:12345-0@lo:104: Request processed in 60us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966880.199667:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783966880.199679:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783966880.199684:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:13188:x1870624587876736:12345-0@lo:104: 00010000:00010000:1.0:1783966880.199692:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.199721:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783966880.199726:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+4:13188:x1870624587876736:12345-0@lo:104: Request processed in 42us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966880.199732:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783966880.199744:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783966880.199750:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:13188:x1870624587876864:12345-0@lo:104: 00010000:00010000:1.0:1783966880.199757:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.199981:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783966880.199987:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8e80b464-a486-4100-b63a-6e6116a9d437+3:13188:x1870624587876864:12345-0@lo:104: Request processed in 238us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966880.199994:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1783966880.200018:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783966880.200024:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200043:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966880.200048:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200056:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966880.200064:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966880.200070:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783966880.200101:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200107:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966880.200129:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200136:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274f800/0x9269c8b316066ed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ed9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200150:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783966880.200153:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200159:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966880.200162:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200178:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966880.200185:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966880.200190:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783966880.200203:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200209:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966880.200216:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200222:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316066ec4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ecb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200232:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783966880.200235:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200241:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966880.200243:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200250:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966880.200256:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966880.200267:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783966880.200282:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200287:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966880.200304:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200310:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316066eb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066ebd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200445:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966880.200450:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200456:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966880.200459:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200465:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966880.200470:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966880.200475:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783966880.200490:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200495:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966880.200507:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200513:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316066ea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066eaf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966880.200528:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966880.200530:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966880.200531:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966880.200540:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966880.200547:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966880.200571:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587877120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966880.200685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966880.200863:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876480:0@lo:104: 00000100:00100000:0.0:1783966880.200873:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876608:0@lo:104: 00000100:00100000:0.0:1783966880.200879:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876736:0@lo:104: 00000100:00100000:0.0:1783966880.200886:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876864:0@lo:104: 00000100:00100000:1.0:1783966880.200976:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966880.200984:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587877248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966880.201008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966880.205303:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587877376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966880.205370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966880.205518:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877120 00000100:00100000:2.0:1783966880.205536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877120 00010000:00010000:2.0:1783966880.205970:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 24 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.206013:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877248 00000100:00100000:2.0:1783966880.206016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877248 00010000:00010000:2.0:1783966880.206029:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.206049:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783966880.206056:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+25:3645:x1870624587877120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.206072:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.206078:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206088:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206106:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1000/0x9269c8b316066ed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ed2 expref: 25 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206120:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.206165:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587877120:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.206173:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783966880.206191:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966880.206210:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+23:3645:x1870624587877248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.206219:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.206224:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206233:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206243:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274ea00/0x9269c8b316066ecb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ec4 expref: 23 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.206251:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.206277:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+22:3645:x1870624587877248:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (5268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.206284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783966880.206443:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef208a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876352:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966880.206459:0:13188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1870624587876992:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966880.206489:0:13188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966880.207006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966880.207068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783966880.207079:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587877504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966880.207134:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587877248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966880.207144:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587877120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966880.208359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966880.208397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877376 00000100:00100000:2.0:1783966880.208406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877376 00010000:00010000:2.0:1783966880.208452:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.208482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678208 00000100:00100000:2.0:1783966880.208485:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678208 00010000:00010000:2.0:1783966880.208498:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.208551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966880.208560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+22:3647:x1870624587877376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.208586:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.208593:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.208604:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.208622:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316066ebd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066eb6 expref: 22 pid: 6510 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.208640:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.208701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+21:3647:x1870624587877376:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.208707:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966880.208725:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1783966880.208731:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563678208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.208739:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.208744:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.208754:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.208764:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316066eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b67 expref: 13 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.209048:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.209095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:2401:x1870624563678208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 363us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.209101:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1783966880.209885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966880.211194:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587877376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966880.211467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678336 00000100:00100000:2.0:1783966880.211474:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678336 00010000:00010000:2.0:1783966880.211514:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.211627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877504 00000100:00100000:2.0:1783966880.211631:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877504 00010000:00010000:2.0:1783966880.211645:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966880.211660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1783966880.211668:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:2401:x1870624563678336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.211682:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.211688:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211698:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211715:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631e00/0x9269c8b316066ea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b28 expref: 12 pid: 6510 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211730:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.211814:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:2401:x1870624563678336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 146us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.211837:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1783966880.211857:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783966880.211864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+21:3647:x1870624587877504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966880.211874:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966880.211878:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211887:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211897:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274e400/0x9269c8b316066eaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066ea8 expref: 21 pid: 6511 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211909:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211927:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211944:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211951:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211957:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211965:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211982:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783966880.211987:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.211996:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.212010:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.212021:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966880.212070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+20:3647:x1870624587877504:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966880.212077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1783966880.212129:0:13188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.212139:0:13188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966880.212145:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050400/0x9269c8b316066f11 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966880.213736:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587877504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783966880.823333:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966881.282962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966881.289949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678464 00000100:00100000:1.0:1783966881.289970:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678464 00000100:00100000:1.0:1783966881.290133:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 316 00000100:00100000:1.0:1783966881.290146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:6175:x1870624563678464:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966881.290187:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966881.290213:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b98 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.290251:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.290265:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.290276:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f800, rc 0) 00000100:00100000:1.0:1783966881.290376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678464:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 233us (7433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966881.290384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 316 00000100:00100000:3.0:1783966881.307732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966881.308225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678592 00000100:00100000:2.0:1783966881.308240:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678592 00000100:00100000:2.0:1783966881.308324:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 317 00000100:00100000:2.0:1783966881.308338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678592:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.309730:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678592:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 1383us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966881.309766:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 317 00000100:00100000:3.0:1783966881.326027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966881.326232:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678720 00000100:00100000:2.0:1783966881.326246:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678720 00000100:00100000:2.0:1783966881.326327:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 318 00000100:00100000:2.0:1783966881.326341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678720:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.326556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678720:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 217us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966881.326572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 318 00000100:00100000:3.0:1783966881.335091:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966881.335272:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678848 00000100:00100000:2.0:1783966881.335287:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678848 00000100:00100000:2.0:1783966881.335376:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 319 00000100:00100000:2.0:1783966881.335389:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563678848:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966881.335411:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966881.335436:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6b9f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.335481:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.335493:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.335505:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783966881.335583:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563678848:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 196us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966881.335590:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 319 00000100:00100000:3.0:1783966881.338999:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966881.339480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563678976 00000100:00100000:1.0:1783966881.339494:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563678976 00000100:00100000:1.0:1783966881.339582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:1.0:1783966881.339595:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563678976:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.339895:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563678976:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 301us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966881.339914:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:3.0:1783966881.342571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966881.342682:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679104 00000100:00100000:0.0:1783966881.342694:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679104 00000100:00100000:0.0:1783966881.342764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 321 00000100:00100000:0.0:1783966881.342815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563679104:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.343018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563679104:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 205us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966881.343028:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 321 10000000:01000000:2.0:1783966881.658932:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783966881.658943:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ef299800 from 7 10000000:01000000:2.0:1783966881.658950:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783966881.659024:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.659040:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.659057:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966881.659099:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.659211:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966881.659284:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3298480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966881.659422:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877632 00000100:00100000:3.0:1783966881.659434:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877632 00000100:00100000:3.0:1783966881.659526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1783966881.659537:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587877632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966881.659557:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966881.659580:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066f26 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.659610:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066f26 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.659625:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f26 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.659638:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0a00, rc 0) 00000100:00100000:3.0:1783966881.659697:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587877632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966881.659705:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1783966881.659750:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966881.659789:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.659800:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966881.659904:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.659939:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966881.659976:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783966881.660025:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877760 00000100:00100000:2.0:1783966881.660030:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877760 00000100:00100000:2.0:1783966881.660064:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1783966881.660072:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587877760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.660267:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587877760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966881.660274:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783966881.660439:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.660490:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.660542:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966881.660569:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c67d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966881.664204:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587877888 00000100:00100000:2.0:1783966881.664228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587877888 00000100:00100000:2.0:1783966881.664322:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1783966881.664335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587877888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.664589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587877888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (4045us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966881.664600:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783966881.665063:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587877888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783966881.671237:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783966881.671524:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783966881.671568:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783966881.671586:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.671602:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966881.671617:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783966881.671621:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff3800 from 7 10000000:01000000:2.0:1783966881.671624:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783966881.671687:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.671697:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.671712:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966881.671752:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.671888:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966881.671954:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3298480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966881.672514:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878016 00000100:00100000:3.0:1783966881.672525:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878016 00000100:00100000:3.0:1783966881.672606:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783966881.672617:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587878016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966881.672634:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966881.672671:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066f34 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.672704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066f34 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.672719:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f34 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.672729:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1e00, rc 0) 00000100:00100000:3.0:1783966881.672952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 336us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966881.672960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1783966881.675041:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966881.675084:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966881.675099:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966881.675252:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966881.675331:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966881.675435:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3298480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966881.687399:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878144 00000100:00100000:0.0:1783966881.687423:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878144 00000100:00100000:0.0:1783966881.687520:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783966881.687535:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.688182:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 645us (12846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966881.688195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1783966881.688325:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.688405:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.688479:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966881.688532:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1780 going to sleep for 11 seconds 00000100:00100000:0.0:1783966881.689265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878272 00000100:00100000:0.0:1783966881.689275:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878272 00000100:00100000:0.0:1783966881.689340:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783966881.689350:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.689530:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966881.689538:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783966881.690415:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1abb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783966881.695071:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783966881.696212:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783966881.696284:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966881.696303:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.696319:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966881.696334:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783966881.696337:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f1a14000 from 7 10000000:01000000:1.0:1783966881.696341:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783966881.696397:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.696406:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.696421:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966881.696458:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.696564:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966881.696623:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966881.696815:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878400 00000100:00100000:0.0:1783966881.696833:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878400 00000100:00100000:0.0:1783966881.696907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783966881.696919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587878400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966881.696936:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966881.696955:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066f42 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.696987:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066f42 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.697002:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f42 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.697011:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050400, rc 0) 00000100:00100000:0.0:1783966881.697064:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966881.697073:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783966881.697371:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966881.697391:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.697402:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966881.697482:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.697521:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966881.697563:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966881.697669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878528 00000100:00100000:0.0:1783966881.697674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878528 00000100:00100000:0.0:1783966881.697712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1783966881.697720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.698119:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 397us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966881.698129:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783966881.698208:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.698251:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.698303:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966881.698342:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966881.698388:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878656 00000100:00100000:3.0:1783966881.698394:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878656 00000100:00100000:3.0:1783966881.698437:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783966881.698445:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.698571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966881.698579:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1783966881.699469:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783966881.703595:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783966881.715999:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783966881.716062:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966881.716084:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.716100:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966881.716114:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783966881.716118:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ed1cf800 from 7 10000000:01000000:1.0:1783966881.716122:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783966881.716184:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.716194:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.716210:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966881.716247:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.716345:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966881.716429:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1783966881.716445:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878784 00000100:00100000:0.0:1783966881.716455:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878784 00000100:00100000:0.0:1783966881.716561:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783966881.716572:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587878784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966881.716589:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966881.716605:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316066f50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.716637:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316066f50 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.716648:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f50 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.716657:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050c00, rc 0) 00000100:00100000:0.0:1783966881.716705:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587878784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966881.716714:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1783966881.719903:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966881.719952:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966881.719968:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966881.720102:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.720226:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966881.720280:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1783966881.721764:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587878912 00000100:00100000:1.0:1783966881.721900:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587878912 00000100:00100000:1.0:1783966881.721979:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1783966881.721991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587878912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966881.724522:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587878912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2516us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966881.724543:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783966881.728450:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587878912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.728935:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587879040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966881.729053:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966881.729106:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605840 going to sleep for 11 seconds 00000100:00100000:3.0:1783966881.729731:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879040 00000100:00100000:3.0:1783966881.729745:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879040 00000100:00100000:3.0:1783966881.729852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783966881.729880:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587879040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966881.730112:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587879040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966881.730120:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1783966881.730126:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587879040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783966881.733383:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783966881.733711:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783966881.733758:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966881.733955:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966881.733971:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966881.856199:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966882.167818:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587879168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966882.167940:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966882.168092:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879168 00000100:00100000:1.0:1783966882.168102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879168 00000100:00100000:1.0:1783966882.168173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783966882.168186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587879168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966882.168238:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966882.168301:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587879168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966882.168308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783966882.168958:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587879168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966882.871380:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966883.080373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966883.080435:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966883.080472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966883.080496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966883.080517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966883.080552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679488 00000100:00100000:3.0:1783966883.080565:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679488 00000100:00100000:3.0:1783966883.080641:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679744 00000100:00100000:3.0:1783966883.080645:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679744 00000100:00100000:3.0:1783966883.080660:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679360 00000100:00100000:3.0:1783966883.080662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679360 00000100:00100000:3.0:1783966883.080674:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679616 00000100:00100000:3.0:1783966883.080677:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679616 00000100:00100000:3.0:1783966883.080714:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:3.0:1783966883.080741:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563679488:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966883.080880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563679488:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 142us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966883.080889:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:3.0:1783966883.080909:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:3.0:1783966883.080916:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563679744:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966883.080945:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563679744:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966883.080951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:3.0:1783966883.080962:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:3.0:1783966883.080968:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563679360:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966883.080992:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563679360:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966883.080998:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:3.0:1783966883.081010:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:3.0:1783966883.081016:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563679616:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966883.081040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563679616:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966883.081046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00080000:2.0:1783966883.081248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966883.081254:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966883.081380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679232 00000100:00100000:0.0:1783966883.081386:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679232 00000100:00100000:0.0:1783966883.081432:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 334 00000100:00100000:0.0:1783966883.081440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563679232:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966883.081493:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563679232:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 54us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966883.081500:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 334 00000100:00100000:1.0:1783966883.703111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587879296:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703238:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587879808:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587880320:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703317:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587880832:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703358:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783966883.703364:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587879680:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703407:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587880192:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703442:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587880704:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587879424:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703539:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587879936:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703575:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587880448:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783966883.703627:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587879552:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703674:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587880064:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703711:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587880576:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.703755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879296 00000100:00100000:1.0:1783966883.703762:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879296 00000100:00100000:1.0:1783966883.703831:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783966883.703840:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.703897:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587879296:12345-0@lo:400:kworker.0 Request processed in 58us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.703904:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783966883.703936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879808 00000100:00100000:1.0:1783966883.703939:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879808 00000100:00100000:1.0:1783966883.703955:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879552 00000100:00100000:1.0:1783966883.703958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879552 00000100:00100000:1.0:1783966883.703972:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783966883.703977:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587879808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704008:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587879808:12345-0@lo:400:kworker.0 Request processed in 31us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704014:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783966883.704025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783966883.704031:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587879552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704061:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587879552:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704067:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783966883.704085:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880320 00000100:00100000:1.0:1783966883.704088:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880320 00000100:00100000:1.0:1783966883.704124:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880832 00000100:00100000:1.0:1783966883.704128:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880832 00000100:00100000:1.0:1783966883.704140:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880192 00000100:00100000:1.0:1783966883.704142:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880192 00000100:00100000:1.0:1783966883.704152:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880704 00000100:00100000:1.0:1783966883.704153:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880704 00000100:00100000:1.0:1783966883.704164:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783966883.704169:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587880320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704195:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587880320:12345-0@lo:400:kworker.0 Request processed in 27us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704201:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783966883.704212:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783966883.704216:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587880832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704238:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587880832:12345-0@lo:400:kworker.0 Request processed in 22us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704243:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783966883.704252:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783966883.704258:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587880192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704280:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587880192:12345-0@lo:400:kworker.0 Request processed in 23us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704285:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783966883.704306:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783966883.704312:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587880704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704334:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587880704:12345-0@lo:400:kworker.0 Request processed in 23us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704340:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783966883.704370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879680 00000100:00100000:1.0:1783966883.704378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879680 00000100:00100000:1.0:1783966883.704395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879424 00000100:00100000:1.0:1783966883.704397:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879424 00000100:00100000:1.0:1783966883.704405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587879936 00000100:00100000:1.0:1783966883.704407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587879936 00000100:00100000:1.0:1783966883.704417:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880448 00000100:00100000:1.0:1783966883.704419:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880448 00000100:00100000:1.0:1783966883.704427:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880064 00000100:00100000:1.0:1783966883.704430:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880064 00000100:00100000:1.0:1783966883.704441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880576 00000100:00100000:1.0:1783966883.704443:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880576 00000100:00100000:1.0:1783966883.704456:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783966883.704461:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587879680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704491:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587879680:12345-0@lo:400:kworker.0 Request processed in 29us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783966883.704510:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783966883.704516:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704540:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587879424:12345-0@lo:400:kworker.0 Request processed in 25us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704545:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783966883.704557:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783966883.704562:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587879936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587879936:12345-0@lo:400:kworker.0 Request processed in 24us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704591:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1783966883.704602:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966883.704607:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587880448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704641:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587880448:12345-0@lo:400:kworker.0 Request processed in 34us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704647:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966883.704657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783966883.704663:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587880064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704687:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587880064:12345-0@lo:400:kworker.0 Request processed in 25us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704693:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783966883.704703:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1783966883.704708:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587880576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704732:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587880576:12345-0@lo:400:kworker.0 Request processed in 24us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.704736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1783966883.704805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966883.704809:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966883.704811:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966883.704814:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966883.704842:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587879552:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.704867:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d95c00 x1870624587880064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.704878:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587880064:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.704889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f63df100 x1870624587880576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.704896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587880576:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704918:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587879424:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704926:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587879936:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704935:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587880448:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.704970:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587879680:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.704980:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d96300 x1870624587880192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.704988:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587880192:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.704997:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f63dc380 x1870624587880704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.705004:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587880704:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.705013:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587879296:0@lo:400:kworker.0 00000100:00100000:1.0:1783966883.705022:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587879808:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.705032:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f63dd500 x1870624587880320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.705040:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587880320:0@lo:400:kworker.0 00010000:00080000:1.0:1783966883.705050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f63ddc00 x1870624587880832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.705058:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587880832:0@lo:400:kworker.0 00000100:00100000:0.0:1783966883.708561:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966883.708599:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966883.708673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966883.708720:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587880960 00000100:00100000:0.0:1783966883.708727:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587880960 00000100:00100000:0.0:1783966883.708821:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783966883.708841:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587880960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966883.708878:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966883.708921:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587880960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966883.708928:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:0.0:1783966883.709049:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf2a00 x1870624587880960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966883.709067:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966883.709800:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966883.709846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966883.710047:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881088 00000100:00100000:1.0:1783966883.710053:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881088 00000100:00100000:1.0:1783966883.710098:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783966883.710106:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783966883.710129:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966883.710169:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966883.710175:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783966883.710195:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587881216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966883.710220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966883.710334:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881216 00000100:00100000:0.0:1783966883.710337:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881216 00000100:00100000:0.0:1783966883.710361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783966883.710367:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587881216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966883.710376:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966883.710402:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587881216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966883.710415:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1783966883.710449:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04a80 x1870624587881088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966883.710467:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966883.710740:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587881344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966883.710792:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966883.710948:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881344 00000100:00100000:3.0:1783966883.710952:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881344 00000100:00100000:3.0:1783966883.710989:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783966883.710996:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587881344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966883.711014:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966883.711047:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587881344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966883.711053:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1783966883.711120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ea300 x1870624587881344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966883.711133:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587881344:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783966883.711200:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dfb80 x1870624587881216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966883.711213:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587881216:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783966883.896049:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966884.217104:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587881472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966884.217178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966884.217247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881472 00000100:00100000:2.0:1783966884.217254:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881472 00000100:00100000:2.0:1783966884.217295:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783966884.217303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587881472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966884.217336:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966884.217376:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587881472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966884.217383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783966884.217420:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587881472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966884.920393:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966885.944133:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783966885.951338:0:13387:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783966886.967367:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966887.288255:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966887.288331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966887.288397:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881600 00000100:00100000:1.0:1783966887.288407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881600 00000100:00100000:1.0:1783966887.288481:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783966887.288492:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966887.288532:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966887.288594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966887.288603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783966887.288679:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881600:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966887.991072:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966888.199099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966888.199150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966888.199196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966888.199217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966888.199253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966888.199294:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680000 00000100:00100000:3.0:1783966888.199307:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680000 00000100:00100000:3.0:1783966888.199359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680256 00000100:00100000:3.0:1783966888.199362:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680256 00000100:00100000:3.0:1783966888.199374:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680128 00000100:00100000:3.0:1783966888.199376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680128 00000100:00100000:3.0:1783966888.199386:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680384 00000100:00100000:3.0:1783966888.199388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680384 00000100:00100000:3.0:1783966888.199402:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:3.0:1783966888.199410:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563680000:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966888.199476:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563680000:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 67us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.199483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:3.0:1783966888.199497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:3.0:1783966888.199503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680256:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966888.199525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680256:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.199546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:3.0:1783966888.199558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:3.0:1783966888.199563:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563680128:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966888.199587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563680128:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.199593:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:3.0:1783966888.199603:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:3.0:1783966888.199609:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680384:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966888.199628:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680384:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.199633:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00080000:3.0:1783966888.199647:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966888.199651:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966888.200135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563679872 00000100:00100000:2.0:1783966888.200142:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563679872 00000100:00100000:2.0:1783966888.200196:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 336 00000100:00100000:2.0:1783966888.200204:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563679872:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966888.200242:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563679872:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966888.200269:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 336 00000100:00100000:0.0:1783966888.823816:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587881728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966888.823885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966888.824372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966888.824385:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966888.824414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966888.824448:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881728 00000100:00100000:0.0:1783966888.824454:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881728 00000100:00100000:0.0:1783966888.824499:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881984 00000100:00100000:0.0:1783966888.824514:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881984 00000100:00100000:0.0:1783966888.824532:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783966888.824539:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587881728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966888.826008:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783966888.826027:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966888.826066:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966888.826070:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587882112:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966888.826887:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966888.826925:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587881856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966888.831210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966888.831530:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587881984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5507us (7111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.831542:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783966888.831568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882112 00000100:00100000:3.0:1783966888.831576:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882112 00000100:00100000:3.0:1783966888.831610:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783966888.831617:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587882112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966888.831725:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966888.831847:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587882112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.831854:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783966888.832074:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587882496:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966888.832136:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587883008:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966888.832180:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783966888.832185:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587882624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832206:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966888.832228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587883136:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832250:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783966888.832274:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966888.832278:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966888.832294:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883008 00000100:00100000:3.0:1783966888.832298:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883008 00000100:00100000:3.0:1783966888.832332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882624 00000100:00100000:3.0:1783966888.832335:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882624 00000100:00100000:3.0:1783966888.832484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883136 00000100:00100000:3.0:1783966888.832489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883136 00000100:00100000:3.0:1783966888.832507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783966888.832514:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587883008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832554:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587883008:12345-0@lo:400:kworker.0 Request processed in 40us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.832560:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1783966888.832572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783966888.832577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587882624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.832615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587882624:12345-0@lo:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.832621:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783966888.833057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1783966888.833067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587883136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.833099:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587883136:12345-0@lo:400:kworker.0 Request processed in 35us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.833104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1783966888.833136:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966888.833139:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966888.833182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587882624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.833193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587883136:0@lo:400:kworker.0 00010000:00080000:3.0:1783966888.833206:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6d880 x1870624587883008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966888.833216:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587883008:0@lo:400:kworker.0 00010000:00080000:3.0:1783966888.833255:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6e300 x1870624587882112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966888.833271:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587882112:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1783966888.833283:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56eb100 x1870624587881984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966888.833294:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587881984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966888.836721:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587881728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12171us (12825us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966888.836760:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783966888.837842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966888.837903:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587882368:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.837947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966888.838168:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587882880:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.838193:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966888.838219:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587883392:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.838242:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966888.838270:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883392 00000100:00100000:1.0:1783966888.838277:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883392 00000100:00100000:1.0:1783966888.838335:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783966888.838343:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587883392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.838403:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587883392:12345-0@lo:400:kworker.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966888.838410:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783966888.838444:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882496 00000100:00100000:1.0:1783966888.838448:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882496 00000100:00100000:1.0:1783966888.838473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783966888.838479:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587882496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.838519:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587882496:12345-0@lo:400:kworker.0 Request processed in 40us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966888.838525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1783966888.838544:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966888.838558:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587882240:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.838586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966888.838609:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587882752:0@lo:400:kworker.0 00000100:00100000:2.0:1783966888.838872:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882368 00000100:00100000:2.0:1783966888.838877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882368 00000100:00100000:2.0:1783966888.838905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882880 00000100:00100000:2.0:1783966888.838908:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882880 00000100:00100000:2.0:1783966888.838934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783966888.838940:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587882368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966888.839110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882752 00000100:00100000:0.0:1783966888.839115:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882752 00000100:00100000:0.0:1783966888.839136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783966888.839142:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587882752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.839147:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587881856 00000100:00100000:3.0:1783966888.839151:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587881856 00000100:00100000:3.0:1783966888.839186:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783966888.839192:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587881856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783966888.839207:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966888.839325:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587883264:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839371:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966888.839408:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56eb480 x1870624587881728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966888.839437:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587881728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966888.839468:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587882240 00000100:00100000:1.0:1783966888.839471:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587882240 00000100:00100000:1.0:1783966888.839495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783966888.839501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587882240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839540:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587882240:12345-0@lo:400:kworker.0 Request processed in 39us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966888.839547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783966888.839575:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883264 00000100:00100000:1.0:1783966888.839578:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883264 00000100:00100000:1.0:1783966888.839596:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783966888.839601:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587882880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839629:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587882880:12345-0@lo:400:kworker.0 Request processed in 28us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966888.839649:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1783966888.839662:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783966888.839667:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587883264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839693:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587883264:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966888.839699:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1783966888.839720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587882240:0@lo:400:kworker.0 00010000:00080000:1.0:1783966888.839730:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708000 x1870624587883264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966888.839745:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587883264:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.839803:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587882496:0@lo:400:kworker.0 00010000:00080000:1.0:1783966888.840564:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708a80 x1870624587883392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966888.840575:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587883392:0@lo:400:kworker.0 00000100:00100000:1.0:1783966888.840598:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587882880:0@lo:400:kworker.0 00000100:00100000:2.0:1783966888.841151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587882368:12345-0@lo:400:kworker.0 Request processed in 2208us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966888.841161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:2.0:1783966888.841203:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966888.841208:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966888.841262:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587882368:0@lo:400:kworker.0 00000100:00100000:3.0:1783966888.841570:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587881856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2376us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966888.841579:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1783966888.841630:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04000 x1870624587881856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966888.841720:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587881856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966888.842808:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587882752:12345-0@lo:400:kworker.0 Request processed in 3662us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966888.842819:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783966888.842946:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587882752:0@lo:400:kworker.0 00010000:00010000:1.0:1783966889.014997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966889.337081:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966889.337125:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587883520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966889.337222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966889.339271:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883520 00000100:00100000:2.0:1783966889.339289:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883520 00000100:00100000:2.0:1783966889.339373:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783966889.339385:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587883520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966889.339438:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783966889.339544:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587883520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966889.339552:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783966889.340296:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587883520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966890.040983:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966891.063050:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966892.087377:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966892.407002:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966892.407032:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587883648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966892.407120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966892.407327:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883648 00000100:00100000:1.0:1783966892.407335:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883648 00000100:00100000:1.0:1783966892.407396:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783966892.407406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587883648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966892.407444:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966892.407504:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587883648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966892.407510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783966892.407713:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587883648:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966893.112680:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966893.323918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.325194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.325224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.325245:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.325304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.325341:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680768 00000100:00100000:1.0:1783966893.325352:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680768 00000100:00100000:1.0:1783966893.325414:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681024 00000100:00100000:1.0:1783966893.325543:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681024 00000100:00100000:1.0:1783966893.325567:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680640 00000100:00100000:1.0:1783966893.325570:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680640 00000100:00100000:1.0:1783966893.325596:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680896 00000100:00100000:1.0:1783966893.325599:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680896 00000100:00100000:1.0:1783966893.325620:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:1.0:1783966893.325630:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563680768:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966893.325885:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563680768:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 255us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.325895:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:1.0:1783966893.325925:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:1.0:1783966893.325934:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563681024:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966893.325967:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563681024:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.325974:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:1.0:1783966893.325992:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:1.0:1783966893.326000:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563680640:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966893.326026:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563680640:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.326032:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:1.0:1783966893.326137:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:1.0:1783966893.326145:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680896:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966893.326173:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563680896:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.326179:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:2.0:1783966893.329238:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563680512 00000100:00100000:2.0:1783966893.329330:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563680512 00000100:00100000:2.0:1783966893.329815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 338 00000100:00100000:2.0:1783966893.329827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563680512:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966893.329917:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563680512:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 92us (6010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.329925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 338 00000100:00080000:2.0:1783966893.333493:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966893.333501:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1783966893.375682:0:13537:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:21:31 (1783966891) === 00000100:00100000:1.0:1783966893.570957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.571006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.571749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681280 00000100:00100000:0.0:1783966893.571760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681280 00000100:00100000:0.0:1783966893.571850:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1783966893.574693:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681152 00000100:00100000:3.0:1783966893.574710:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681152 00000100:00100000:3.0:1783966893.574796:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783966893.574808:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563681152:12345-192.168.204.59@tcp:41:mkdir.0 00000004:00000024:3.0:1783966893.574853:0:7847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966893.574950:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563681152:12345-192.168.204.59@tcp:41:mkdir.0 Request processed in 145us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966893.574958:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1783966893.575729:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:10497:x1870624563681280:12345-192.168.204.59@tcp:700:mkdir.0 00000100:00100000:0.0:1783966893.575811:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:10497:x1870624563681280:12345-192.168.204.59@tcp:700:mkdir.0 Request processed in 3950us (4803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.585570:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1783966893.589216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.594829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681536 00000100:00100000:3.0:1783966893.594846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681536 00000100:00100000:3.0:1783966893.594912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783966893.594923:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:10497:x1870624563681536:12345-192.168.204.59@tcp:36:mkdir.0 00010000:00010000:3.0:1783966893.594981:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966893.595064:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316066e00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b13 expref: 6 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595103:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc8200) 00010000:00010000:3.0:1783966893.595133:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966893.595225:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595236:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595246:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595271:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595279:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595286:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595904:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595915:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595923:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966893.595938:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003a1d9aa reply state 0000000012f8b1e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595962:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595968:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:3.0:1783966893.595971:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966893.595975:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783966893.595980:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783966893.595988:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.595995:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596001:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596008:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966893.596012:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596019:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596028:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3424b00) 00010000:00010000:3.0:1783966893.596030:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966893.596034:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596039:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966893.596067:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003a1d9aa reply state 0000000012f8b1e9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596076:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.596082:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c3424600) 00010000:00010000:3.0:1783966893.596084:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966893.596086:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783966893.596182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10497:x1870624563681536:12345-192.168.204.59@tcp:36:mkdir.0 Request processed in 1258us (6976us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783966893.596190:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783966893.603938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966893.604063:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681664 00000100:00100000:2.0:1783966893.604074:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681664 00000100:00100000:2.0:1783966893.604136:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1783966893.604146:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10498:x1870624563681664:12345-192.168.204.59@tcp:101:chmod.0 00010000:00010000:2.0:1783966893.604178:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966893.604206:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ba6 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604288:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604302:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604314:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966893.604362:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966893.604378:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966893.604415:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604440:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ba6 expref: 9 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604460:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ba6 expref: 8 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.604469:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc8b00) 00010000:00010000:2.0:1783966893.604472:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966893.604475:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966893.604541:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:10498:x1870624563681664:12345-192.168.204.59@tcp:101:chmod.0 Request processed in 396us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.604549:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783966893.610125:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.610464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563681920 00000100:00100000:1.0:1783966893.610476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563681920 00000100:00100000:1.0:1783966893.610561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1783966893.610575:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:10498:x1870624563681920:12345-192.168.204.59@tcp:36:chmod.0 00010000:00010000:1.0:1783966893.610637:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966893.610679:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316066f7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ba6 expref: 8 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.610697:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc8b00) 00010000:00010000:1.0:1783966893.610709:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966893.610738:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.610753:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.610765:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966893.611037:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079f1c7f1 reply state 000000001e592dc4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.611056:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.611063:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:1.0:1783966893.611066:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783966893.611069:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783966893.611077:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783966893.611168:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:10498:x1870624563681920:12345-192.168.204.59@tcp:36:chmod.0 Request processed in 595us (1053us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783966893.611177:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1783966893.652714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966893.655885:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682048 00000100:00100000:2.0:1783966893.655903:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682048 00000100:00100000:2.0:1783966893.656016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1783966893.656028:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:10499:x1870624563682048:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:2.0:1783966893.656057:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966893.656080:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656161:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656178:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656213:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966893.656286:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966893.656290:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966893.656330:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656357:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bad expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656379:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bad expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.656390:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:2.0:1783966893.656393:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966893.656398:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:2.0:1783966893.656500:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:10499:x1870624563682048:12345-192.168.204.59@tcp:101:chown.0 Request processed in 474us (3795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.656508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1783966893.659225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.659442:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682176 00000100:00100000:3.0:1783966893.659453:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682176 00000100:00100000:3.0:1783966893.659518:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783966893.659530:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:10499:x1870624563682176:12345-192.168.204.59@tcp:101:chown.0 00010000:00010000:3.0:1783966893.659554:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966893.659580:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bb4 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659659:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659685:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659696:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659723:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659730:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659736:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659858:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659867:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659875:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966893.659920:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783966893.659924:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966893.659948:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659961:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659968:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659975:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.659992:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966893.659997:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660005:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660019:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:3.0:1783966893.660022:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966893.660027:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660034:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316066f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660049:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660056:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660063:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660068:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966893.660072:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660079:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660097:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c3424600) 00010000:00010000:3.0:1783966893.660100:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966893.660103:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660109:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316066fa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660135:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316066f96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bb4 expref: 12 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660149:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bb4 expref: 11 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.660155:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:3.0:1783966893.660157:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783966893.660160:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0c00, rc 0) 00000100:00100000:3.0:1783966893.660338:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10499:x1870624563682176:12345-192.168.204.59@tcp:101:chown.0 Request processed in 809us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966893.660346:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783966893.664867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.667455:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682304 00000100:00100000:0.0:1783966893.667474:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682304 00000100:00100000:0.0:1783966893.667553:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1783966893.667567:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10499:x1870624563682304:12345-192.168.204.59@tcp:900:chown.0 00000100:00100000:0.0:1783966893.667697:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10499:x1870624563682304:12345-192.168.204.59@tcp:900:chown.0 Request processed in 134us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.667704:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1783966893.671954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.672044:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682560 00000100:00100000:3.0:1783966893.672056:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682560 00000100:00100000:3.0:1783966893.672120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783966893.672131:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10499:x1870624563682560:12345-192.168.204.59@tcp:36:chown.0 00010000:00010000:3.0:1783966893.672189:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966893.672219:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316066fab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bb4 expref: 11 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.672268:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:3.0:1783966893.672273:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966893.672299:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.672313:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.672323:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783966893.682019:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1783966893.682142:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682169:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682178:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682185:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.682190:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682199:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682219:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c3424600) 00010000:00010000:0.0:1783966893.682223:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.682228:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682235:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316066f65 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682270:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682278:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682285:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682290:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.682299:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682306:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682315:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:0.0:1783966893.682318:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.682321:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682336:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316066f6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682351:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682358:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682364:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682369:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.682372:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682378:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682385:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:0.0:1783966893.682388:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783966893.682398:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.682404:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f200/0x9269c8b316066f81 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966893.682685:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d20cfc53 reply state 00000000da44b9fc transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.682701:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.682709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:2.0:1783966893.682717:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783966893.682721:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783966893.682734:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1783966893.682869:0:6517:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783966893.682894:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10499:x1870624563682560:12345-192.168.204.59@tcp:36:chown.0 Request processed in 10759us (10945us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783966893.682903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00010000:00010000:1.0:1783966893.683902:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683917:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683924:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683930:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966893.683935:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683942:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683956:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3424c00) 00010000:00010000:1.0:1783966893.683959:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783966893.683969:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.683976:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316066fb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966893.722050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.722170:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682688 00000100:00100000:1.0:1783966893.722181:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682688 00000100:00100000:1.0:1783966893.722244:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:1.0:1783966893.722256:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:10500:x1870624563682688:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:1.0:1783966893.722280:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966893.722301:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fe00/0x9269c8b316066fb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bbb expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783966893.728815:0:10203:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6449us 00010000:00010000:0.0:1783966893.752020:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752044:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752055:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752071:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752076:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752082:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752234:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752243:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752250:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966893.752286:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783966893.752296:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966893.752344:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752358:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752365:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752372:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752378:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.752383:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752391:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752404:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:0.0:1783966893.752407:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.752411:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752417:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316066fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752428:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752434:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752450:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752457:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.752460:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752466:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752475:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c3347500) 00010000:00010000:0.0:1783966893.752477:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.752480:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752486:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316066fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752526:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fe00/0x9269c8b316066fb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bbb expref: 8 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752543:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bbb expref: 7 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.752551:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.752553:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783966893.752555:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050000, rc 0) 00000100:00100000:0.0:1783966893.752629:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10500:x1870624563682688:12345-192.168.204.59@tcp:101:touch.500 Request processed in 30374us (30590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.752647:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1783966893.759416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.759462:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563682944 00000100:00100000:0.0:1783966893.759474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563682944 00000100:00100000:0.0:1783966893.759534:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1783966893.759546:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10500:x1870624563682944:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:0.0:1783966893.759567:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966893.759588:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bc2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.759727:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.759744:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.759758:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.760425:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.760438:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.760447:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783966893.761551:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1783966893.761747:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316066fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.762952:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316066fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.762975:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316066fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763048:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763057:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763064:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763071:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.763075:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763083:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763096:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.763100:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.763105:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763112:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316066fdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966893.763126:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017caebb3 reply state 000000000f571dea transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763150:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763157:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff9a04c3347300) 00010000:00010000:0.0:1783966893.763159:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966893.763162:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783966893.763213:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc2 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763229:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316066fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc2 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.763237:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c3347c00) 00010000:00010000:0.0:1783966893.763239:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966893.763241:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051600, rc 0) 00000100:00100000:0.0:1783966893.763313:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:10500:x1870624563682944:12345-192.168.204.59@tcp:101:touch.500 Request processed in 3769us (3909us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783966893.763322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1783966893.771701:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966893.771977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683200 00000100:00100000:2.0:1783966893.771986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683200 00000100:00100000:2.0:1783966893.772048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1783966893.772060:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:10500:x1870624563683200:12345-192.168.204.59@tcp:36:touch.500 00010000:00010000:2.0:1783966893.772121:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966893.772148:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316066fea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc2 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.772167:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c3347c00) 00010000:00010000:2.0:1783966893.772178:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966893.772240:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.772255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.772265:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966893.772479:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d8c6ed8 reply state 0000000039ebca47 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.772493:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.772513:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:2.0:1783966893.772516:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966893.772519:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966893.772605:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10500:x1870624563683200:12345-192.168.204.59@tcp:36:touch.500 Request processed in 547us (914us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783966893.772613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783966893.786740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.789411:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683328 00000100:00100000:0.0:1783966893.789430:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683328 00000100:00100000:0.0:1783966893.789638:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1783966893.789650:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:10500:x1870624563683328:12345-192.168.204.59@tcp:101:touch.500 00010000:00010000:0.0:1783966893.789687:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966893.789711:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bc9 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.789897:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc9 expref: 12 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.789915:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc9 expref: 12 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.789935:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:0.0:1783966893.789938:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783966893.789942:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050800, rc 0) 00000100:00100000:0.0:1783966893.790016:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:10500:x1870624563683328:12345-192.168.204.59@tcp:101:touch.500 Request processed in 369us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.790023:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1783966893.793502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.793686:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683456 00000100:00100000:0.0:1783966893.793697:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683456 00000100:00100000:0.0:1783966893.793822:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783966893.793831:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563683456:12345-192.168.204.59@tcp:8:touch.500 00010000:00080000:0.0:1783966893.793869:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:0.0:1783966893.793906:0:8434:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316067006 00002000:00100000:0.0:1783966893.793919:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4272c10e-7366-407e-b067-e3d2ea5c5b05/ffff9a04c3cc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783966893.793938:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1783966893.794021:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783966893.794051:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783966893.794128:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563683456:12345-192.168.204.59@tcp:8:touch.500 Request processed in 296us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.794155:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1783966893.796923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.797020:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683584 00000100:00100000:3.0:1783966893.797030:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683584 00000100:00080000:2.0:1783966893.797175:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966893.797271:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1783966893.797284:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:0:x1870624563683584:12345-192.168.204.59@tcp:2:touch.500 00000001:00080000:2.0:1783966893.815338:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1783966893.815357:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000100:00100000:3.0:1783966893.815829:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:0:x1870624563683584:12345-192.168.204.59@tcp:2:touch.500 Request processed in 18539us (18908us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783966893.815841:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1783966893.823164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.825417:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683840 00000100:00100000:0.0:1783966893.825431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683840 00000100:00100000:0.0:1783966893.825494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1783966893.825505:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:10500:x1870624563683840:12345-192.168.204.59@tcp:35:touch.500 00000100:00100000:0.0:1783966893.825873:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:10500:x1870624563683840:12345-192.168.204.59@tcp:35:touch.500 Request processed in 369us (2722us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783966893.825881:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1783966893.840167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.842735:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563683968 00000100:00100000:0.0:1783966893.842751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563683968 00000100:00100000:0.0:1783966893.842902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:0.0:1783966893.842914:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:10501:x1870624563683968:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:0.0:1783966893.842941:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966893.842965:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606700d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bd0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843040:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843053:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843065:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966893.843110:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783966893.843114:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966893.843169:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843196:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606700d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bd0 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843215:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bd0 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.843225:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.843228:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783966893.843232:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051e00, rc 0) 00000100:00100000:0.0:1783966893.843300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:10501:x1870624563683968:12345-192.168.204.59@tcp:101:rm.0 Request processed in 388us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.843307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1783966893.853765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.853897:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563684224 00000100:00100000:3.0:1783966893.853908:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563684224 00000100:00100000:3.0:1783966893.853967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1783966893.853980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:10501:x1870624563684224:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:3.0:1783966893.854001:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966893.854033:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b31606701b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bd7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966893.854143:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783966893.854301:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b31606701b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bd7 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.854317:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:3.0:1783966893.854320:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966893.854336:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b31606701b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bd7 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.854350:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0c00, rc 0) 00000100:00100000:3.0:1783966893.854418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:10501:x1870624563684224:12345-192.168.204.59@tcp:101:rm.0 Request processed in 440us (662us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1783966893.854425:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:2.0:1783966893.869941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.870488:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563684352 00000100:00100000:0.0:1783966893.870499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563684352 00000100:00100000:0.0:1783966893.870570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1783966893.870581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:10501:x1870624563684352:12345-192.168.204.59@tcp:37:rm.0 00000100:00100000:1.0:1783966893.881119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:10501:x1870624563684352:12345-192.168.204.59@tcp:37:rm.0 Request processed in 10525us (11180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.881136:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1783966893.887392:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966893.887909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563684608 00000100:00100000:1.0:1783966893.887922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563684608 00000100:00100000:1.0:1783966893.887991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1783966893.888003:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:10501:x1870624563684608:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:1.0:1783966893.888298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:10501:x1870624563684608:12345-192.168.204.59@tcp:35:rm.0 Request processed in 296us (917us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783966893.888308:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783966893.893404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.893536:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563684864 00000100:00100000:0.0:1783966893.893556:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563684864 00000100:00100000:0.0:1783966893.893624:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1783966893.893636:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:10501:x1870624563684864:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:0.0:1783966893.893675:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966893.893699:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316067029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bde expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.894064:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316067030 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.894752:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316067030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.894765:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316067030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966893.895576:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783966893.895741:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b316067029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bde expref: 19 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.895763:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316067030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bde expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.896367:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.896370:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783966893.896374:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050600, rc 0) 00000100:00100000:0.0:1783966893.896477:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563684864:12345-192.168.204.59@tcp:101:rm.0 Request processed in 2840us (3087us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783966893.896486:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:0.0:1783966893.902280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.902702:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563684992 00000100:00100000:3.0:1783966893.902715:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563684992 00000100:00100000:3.0:1783966893.902825:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1783966893.902840:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563684992:12345-192.168.204.59@tcp:41:rm.0 00000004:00000024:3.0:1783966893.902920:0:7847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1783966893.903011:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563684992:12345-192.168.204.59@tcp:41:rm.0 Request processed in 174us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966893.903019:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783966893.907180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966893.907297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563685120 00000100:00100000:3.0:1783966893.907308:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563685120 00000100:00100000:3.0:1783966893.907502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1783966893.907512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563685120:12345-192.168.204.59@tcp:101:rm.0 00010000:00010000:3.0:1783966893.907607:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966893.907633:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b31606703e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6be5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.907720:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.907737:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.907750:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.907761:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.908751:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.909435:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.911480:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.911507:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.911520:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966893.911991:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783966893.912013:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966893.912039:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912052:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912061:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912067:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912073:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912078:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966893.912082:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912089:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912102:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:3.0:1783966893.912105:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966893.912110:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912116:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0200/0x9269c8b316067045 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912134:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912156:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912161:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912165:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966893.912169:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912175:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912183:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff9a04c3347300) 00010000:00010000:3.0:1783966893.912185:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966893.912188:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b31606704c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912234:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b31606703e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6be5 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912249:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6be5 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966893.912256:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:3.0:1783966893.912259:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966893.912267:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00100000:3.0:1783966893.912365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:10501:x1870624563685120:12345-192.168.204.59@tcp:101:rm.0 Request processed in 4852us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966893.912375:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1783966893.920696:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.920890:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563685376 00000100:00100000:0.0:1783966893.920899:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563685376 00000100:00100000:0.0:1783966893.920955:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:0.0:1783966893.920967:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:10501:x1870624563685376:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:0.0:1783966893.921031:0:10203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783966893.921059:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067053 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6be5 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921104:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050800/0x9269c8b316066fff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bc9 expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921116:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:0.0:1783966893.921126:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b316067014 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bd0 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921135:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.921138:0:10203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966893.921160:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921171:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921180:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921190:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921197:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921203:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921305:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921330:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921339:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783966893.921572:0:10203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783966893.921581:0:10203:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370122810447ns, next at 371122808407ns, rc = 0 00010000:00010000:0.0:1783966893.921629:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921720:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921728:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921735:0:10203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921740:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921746:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921891:0:10203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783966893.921911:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921917:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921930:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921936:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.921939:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921946:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921954:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:0.0:1783966893.921957:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783966893.921960:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921966:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1800/0x9269c8b316067068 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921982:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921988:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921993:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.921998:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966893.922000:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.922015:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.922023:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:0.0:1783966893.922025:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966893.922028:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.922033:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b31606705a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966893.922043:0:10203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026ae1e36 reply state 0000000056dc1944 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.922053:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966893.922072:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff9a04c3347300) 00010000:00010000:0.0:1783966893.922075:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966893.922078:0:10203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966893.922157:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563685376:12345-192.168.204.59@tcp:36:rm.0 Request processed in 1190us (1470us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783966893.922165:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00010000:00010000:1.0:1783966893.923201:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966893.923218:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.923227:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966893.923231:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.923241:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.923257:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:1.0:1783966893.923259:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783966893.923262:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.923268:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b31606706f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966893.923284:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966893.923286:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966893.923287:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966893.927294:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966893.927472:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563685632 00000100:00100000:0.0:1783966893.927486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563685632 00000100:00100000:0.0:1783966893.927630:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1783966893.927653:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563685632:12345-192.168.204.59@tcp:35:rm.0 00000100:00100000:0.0:1783966893.927965:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:10501:x1870624563685632:12345-192.168.204.59@tcp:35:rm.0 Request processed in 315us (681us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783966893.927991:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783966893.930897:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966893.931055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563685888 00000100:00100000:2.0:1783966893.931067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563685888 00000100:00100000:2.0:1783966893.931145:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:2.0:1783966893.931156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:10501:x1870624563685888:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:2.0:1783966893.931239:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783966893.931269:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316067030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bde expref: 19 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931293:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316066fce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bbb expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931305:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c3347100) 00010000:00010000:2.0:1783966893.931353:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316066f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bad expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931363:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7df500) 00010000:00010000:2.0:1783966893.931369:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966893.931396:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931409:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931418:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931429:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931434:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931440:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931533:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931552:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931561:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966893.931868:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783966893.931894:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931900:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931906:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931912:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966893.931916:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931924:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931933:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a04c1cc8c00) 00010000:00010000:2.0:1783966893.931936:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783966893.931940:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931948:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067084 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931969:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931975:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931981:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.931985:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966893.931994:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.932000:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.932008:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc8f00) 00010000:00010000:2.0:1783966893.932010:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966893.932013:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.932019:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067076 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966893.932031:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e88cef32 reply state 000000002f5b0c1b transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.932043:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966893.932048:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c1cc8300) 00010000:00010000:2.0:1783966893.932050:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966893.932054:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966893.932145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:10501:x1870624563685888:12345-192.168.204.59@tcp:36:rm.0 Request processed in 990us (1260us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783966893.932153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1783966893.943446:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587884032:0@lo:400:kworker.0 00000100:00100000:3.0:1783966893.943525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966893.943626:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587884544:0@lo:400:kworker.0 00000100:00100000:3.0:1783966893.943678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.943800:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587883776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966893.943836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.943867:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587884288:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.943896:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587883904:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.943928:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.943954:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587884416:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.944021:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587884928:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.944064:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587885440:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944085:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966893.944146:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883776 00000100:00100000:1.0:1783966893.944154:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883776 00000100:00100000:1.0:1783966893.944212:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783966893.944222:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587883776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783966893.944253:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966893.944297:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587883776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.944305:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783966893.944337:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587883904 00000100:00100000:1.0:1783966893.944341:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587883904 00000100:00100000:1.0:1783966893.944365:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783966893.944371:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587883904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944406:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587883904:12345-0@lo:400:kworker.0 Request processed in 35us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.944413:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1783966893.944437:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884416 00000100:00100000:1.0:1783966893.944440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884416 00000100:00100000:1.0:1783966893.944463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783966893.944469:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587884416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944498:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587884416:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.944514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1783966893.944535:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966893.944545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884928 00000100:00100000:1.0:1783966893.944549:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884928 00000100:00100000:1.0:1783966893.944576:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885440 00000100:00100000:1.0:1783966893.944579:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885440 00000100:00100000:1.0:1783966893.944596:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783966893.944601:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587884928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944633:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587884928:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.944638:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783966893.944647:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783966893.944652:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587885440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944687:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587885440:12345-0@lo:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.944692:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783966893.944705:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966893.944708:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966893.944732:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587883904:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.944745:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587884416:0@lo:400:kworker.0 00010000:00080000:1.0:1783966893.944758:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ace00 x1870624587884928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966893.944794:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587884928:0@lo:400:kworker.0 00010000:00080000:1.0:1783966893.944807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56aed80 x1870624587885440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966893.944829:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587885440:0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.949066:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966893.949105:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587885824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966893.949207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966893.949340:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885824 00000100:00100000:0.0:1783966893.949350:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885824 00000100:00100000:0.0:1783966893.949413:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783966893.949423:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587885824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966893.949453:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966893.949508:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587885824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.949516:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1783966893.949578:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56e8000 x1870624587885824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966893.949601:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587885824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966893.951071:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587885056:0@lo:400:kworker.0 00000100:00100000:3.0:1783966893.951134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966893.951151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884032 00000100:00100000:2.0:1783966893.951160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884032 00000100:00100000:0.0:1783966893.952891:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587884160:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.952972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966893.953027:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587884672:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.954986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884160 00000100:00100000:0.0:1783966893.955008:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884160 00000100:00100000:0.0:1783966893.955086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783966893.955099:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587884160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.955218:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587884160:12345-0@lo:400:kworker.0 Request processed in 121us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.955226:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783966893.955479:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884544 00000100:00100000:1.0:1783966893.955484:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884544 00000100:00100000:1.0:1783966893.955538:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783966893.955557:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587884032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.955599:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587884032:12345-0@lo:400:kworker.0 Request processed in 45us (12075us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.955605:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783966893.955620:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1783966893.955625:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587884544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966893.956156:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587884544:12345-0@lo:400:kworker.0 Request processed in 529us (12476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966893.956164:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1783966893.956260:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966893.956616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966893.956679:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587885184:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.956740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966893.956759:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587885696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966893.956978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966893.957031:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587884160:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.957061:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885696 00000100:00100000:0.0:1783966893.957067:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885696 00000100:00100000:0.0:1783966893.957107:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783966893.957115:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587885696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966893.957135:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966893.957174:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587885696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.957181:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1783966893.957197:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783966893.957216:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729500 x1870624587885696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966893.957234:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587885696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966893.957253:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885056 00000100:00100000:0.0:1783966893.957257:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885056 00000100:00080000:0.0:1783966893.957272:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966893.957294:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884672 00000100:00100000:0.0:1783966893.957297:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884672 00000100:00080000:0.0:1783966893.957310:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966893.957399:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885184 00000100:00100000:0.0:1783966893.957403:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885184 00000100:00080000:0.0:1783966893.957417:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966893.957428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783966893.957436:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587885056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.957480:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587885056:12345-0@lo:400:kworker.0 Request processed in 44us (6346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.957488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783966893.957503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783966893.957509:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587884672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.957540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587884672:12345-0@lo:400:kworker.0 Request processed in 31us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.957757:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00080000:0.0:1783966893.958425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ad500 x1870624587884672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966893.958438:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587884672:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.958492:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783966893.958514:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587885184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.958842:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966893.958887:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587884800:0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.958928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966893.958966:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587885312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.958992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783966893.959027:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c6c380 x1870624587883776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966893.959044:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587883776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966893.959066:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884800 00000100:00100000:2.0:1783966893.959071:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884800 00000100:00100000:2.0:1783966893.959099:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885312 00000100:00100000:2.0:1783966893.959102:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885312 00000100:00100000:2.0:1783966893.959116:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783966893.959123:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587884800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.959161:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587884800:12345-0@lo:400:kworker.0 Request processed in 38us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.959168:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783966893.959182:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783966893.959187:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587885312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.959226:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587885312:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.959232:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1783966893.959262:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56aea00 x1870624587884800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966893.959273:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587884800:0@lo:400:kworker.0 00010000:00080000:2.0:1783966893.959283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56afb80 x1870624587885312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966893.959291:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587885312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.959332:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587884288 00000100:00100000:2.0:1783966893.959336:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587884288 00000100:00100000:2.0:1783966893.959360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783966893.959365:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587884288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966893.959400:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587884288:12345-0@lo:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966893.959407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1783966893.959434:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587884288:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.960105:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587885184:12345-0@lo:400:kworker.0 Request processed in 1590us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.960114:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783966893.960223:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587885056:0@lo:400:kworker.0 00000100:00100000:3.0:1783966893.960235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587885568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966893.960267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966893.960311:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587884032:0@lo:400:kworker.0 00000100:00100000:3.0:1783966893.960334:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587884544:0@lo:400:kworker.0 00000100:00100000:0.0:1783966893.960454:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885568 00000100:00100000:0.0:1783966893.960459:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885568 00000100:00100000:0.0:1783966893.960504:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783966893.960513:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587885568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966893.960533:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966893.961167:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587885568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 654us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966893.961175:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1783966893.961251:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ac700 x1870624587885184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966893.961263:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587885184:0@lo:400:kworker.0 00010000:00080000:3.0:1783966893.961397:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ea300 x1870624587885568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966893.961413:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587885568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783966894.135454:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966894.466384:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587885952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966894.466499:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966894.468765:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587885952 00000100:00100000:3.0:1783966894.469071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587885952 00000100:00100000:3.0:1783966894.469144:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783966894.469554:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587885952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966894.469597:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966894.475724:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587885952:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966894.480311:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587885952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10748us (13797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966894.480328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:0.0:1783966895.159326:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966896.191667:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966897.210106:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966897.527988:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966897.528013:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587886080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966897.528086:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966897.528820:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886080 00000100:00100000:1.0:1783966897.528829:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886080 00000100:00100000:1.0:1783966897.528879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783966897.528890:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587886080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966897.528945:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966897.529014:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587886080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966897.529021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783966897.532346:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587886080:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966898.230971:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966898.436071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966898.436240:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686272 00000100:00100000:3.0:1783966898.436249:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686272 00000100:00100000:3.0:1783966898.436297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686528 00000100:00100000:3.0:1783966898.436300:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686528 00000100:00100000:3.0:1783966898.436311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686144 00000100:00100000:3.0:1783966898.436313:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686144 00000100:00100000:3.0:1783966898.436324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686656 00000100:00100000:3.0:1783966898.436326:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686656 00000100:00100000:3.0:1783966898.436341:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:3.0:1783966898.436351:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563686272:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966898.436424:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563686272:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966898.436432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:3.0:1783966898.436449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:3.0:1783966898.436455:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563686528:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966898.436480:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563686528:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966898.436486:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:3.0:1783966898.436505:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:3.0:1783966898.436510:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2401:x1870624563686144:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966898.436541:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2401:x1870624563686144:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966898.436546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:3.0:1783966898.436559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1783966898.436565:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563686656:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966898.436602:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563686656:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966898.436608:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1783966898.436635:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686400 00000100:00100000:3.0:1783966898.436638:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686400 00000100:00100000:3.0:1783966898.436665:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:3.0:1783966898.436672:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563686400:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966898.436699:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563686400:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966898.436705:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783966898.437085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686016 00000100:00100000:0.0:1783966898.437090:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686016 00000100:00080000:1.0:1783966898.437107:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783966898.437112:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966898.437114:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966898.437121:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 340 00000100:00100000:0.0:1783966898.437127:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563686016:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966898.437171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563686016:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 44us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966898.437178:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 340 00000001:02000400:1.0:1783966898.924630:0:13685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1783966899.067432:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587886208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966899.067516:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.067660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886208 00000100:00100000:0.0:1783966899.067668:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886208 00000100:00100000:0.0:1783966899.067727:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783966899.067737:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587886208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966899.067787:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966899.067834:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587886208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.067841:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1783966899.067863:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966899.067893:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3ccce00 x1870624587886208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.067911:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587886208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966899.069401:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587886336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966899.069462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.071899:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886336 00000100:00100000:0.0:1783966899.071909:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886336 00000100:00100000:0.0:1783966899.071969:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966899.071982:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587886336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966899.072017:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966899.072146:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587886336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (2683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.072154:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966899.073318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587886592:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.073394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.073449:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587887104:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.073470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.074634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587887616:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.074677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.074709:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966899.074716:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587886720:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.074740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.074757:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587887232:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.074791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.074809:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587887744:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.074833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.074875:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886592 00000100:00100000:0.0:1783966899.074882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886592 00000100:00100000:0.0:1783966899.074926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887104 00000100:00100000:0.0:1783966899.074929:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887104 00000100:00100000:0.0:1783966899.074944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887616 00000100:00100000:0.0:1783966899.074958:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887616 00000100:00100000:0.0:1783966899.074972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887232 00000100:00100000:0.0:1783966899.074975:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887232 00000100:00100000:0.0:1783966899.074990:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783966899.074997:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587886592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.075047:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587886592:12345-0@lo:400:kworker.0 Request processed in 50us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.075055:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1783966899.075072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783966899.075078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587887104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.075102:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587887104:12345-0@lo:400:kworker.0 Request processed in 25us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.075109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1783966899.075119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783966899.075124:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587887616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.075149:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587887616:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.075155:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1783966899.075164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783966899.075169:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587887232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.075957:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587886464:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.076038:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587886976:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.076090:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587887488:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076129:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.076151:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783966899.076158:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587886848:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.076215:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587887360:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076237:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.076264:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886464 00000100:00100000:1.0:1783966899.076269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886464 00000100:00100000:1.0:1783966899.076304:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783966899.076311:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587886464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076359:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587886464:12345-0@lo:400:kworker.0 Request processed in 48us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.076366:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1783966899.076391:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887488 00000100:00100000:1.0:1783966899.076395:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887488 00000100:00100000:1.0:1783966899.076414:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886848 00000100:00100000:1.0:1783966899.076417:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886848 00000100:00100000:1.0:1783966899.076428:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783966899.076435:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587887488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076462:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587887488:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.076468:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783966899.076612:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783966899.076619:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587886848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076648:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587886848:12345-0@lo:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.076653:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1783966899.076678:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966899.076683:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783966899.076685:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783966899.076718:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372a300 x1870624587886336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966899.076753:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587886336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966899.076818:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587886848:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076828:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587886464:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.076836:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587887488:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.078756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587887232:12345-0@lo:400:kworker.0 Request processed in 3576us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.078832:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887744 00000100:00100000:1.0:1783966899.078841:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887744 00000100:00100000:1.0:1783966899.078911:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887360 00000100:00100000:1.0:1783966899.078915:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887360 00000100:00100000:1.0:1783966899.078940:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783966899.078948:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587887744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.079003:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587887744:12345-0@lo:400:kworker.0 Request processed in 56us (4168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.079011:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783966899.079025:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783966899.079031:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587887360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.079065:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587887360:12345-0@lo:400:kworker.0 Request processed in 34us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.079071:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783966899.079094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886720 00000100:00100000:1.0:1783966899.079097:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886720 00000100:00100000:1.0:1783966899.079115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587886976 00000100:00100000:1.0:1783966899.079118:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587886976 00000100:00100000:1.0:1783966899.079130:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783966899.079135:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587886720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.079616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783966899.079674:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587886720:0@lo:400:kworker.0 00010000:00080000:0.0:1783966899.079691:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c94e00 x1870624587887232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.079716:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587887232:0@lo:400:kworker.0 00010000:00080000:0.0:1783966899.079729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c96d80 x1870624587887744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.079737:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587887744:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.079750:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587886592:0@lo:400:kworker.0 00000100:00100000:0.0:1783966899.079761:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587887104:0@lo:400:kworker.0 00010000:00080000:0.0:1783966899.079787:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c97b80 x1870624587887616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.079796:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587887616:0@lo:400:kworker.0 00000100:00080000:0.0:1783966899.079851:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966899.079855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966899.079880:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c95f80 x1870624587887360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.079890:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587887360:0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.080707:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587886720:12345-0@lo:400:kworker.0 Request processed in 1567us (5962us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.080718:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783966899.080743:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783966899.080756:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587886976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966899.080840:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587886976:12345-0@lo:400:kworker.0 Request processed in 90us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.080847:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783966899.081261:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587887872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966899.081301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.084734:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587887872 00000100:00100000:0.0:1783966899.084746:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587887872 00000100:00100000:0.0:1783966899.084840:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783966899.084851:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587887872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966899.084876:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966899.084956:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587887872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (3654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966899.084964:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1783966899.085029:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3cf4e00 x1870624587887872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966899.085048:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587887872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966899.085091:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587886976:0@lo:400:kworker.0 00000004:00080000:1.0:1783966899.086259:0:8710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375287488030ns, next at 376287485478ns, rc = 0 00000100:00100000:0.0:1783966899.094356:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966899.094387:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587888000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966899.094489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966899.094667:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888000 00000100:00100000:3.0:1783966899.094675:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888000 00000100:00100000:3.0:1783966899.094731:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783966899.094741:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587888000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966899.094787:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966899.094840:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587888000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966899.094863:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1783966899.094907:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c371b800 x1870624587888000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966899.094926:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587888000:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1783966899.100639:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783966899.100676:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1783966899.100687:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783966899.103558:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103583:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103592:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103600:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966899.103605:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103614:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103634:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff9a04c3347300) 00010000:00010000:0.0:1783966899.103637:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966899.103642:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103649:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051200/0x9269c8b316066fe3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103677:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103683:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103689:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103694:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966899.103697:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103703:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103710:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a04c1cc8600) 00010000:00010000:0.0:1783966899.103713:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966899.103716:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103721:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316066ff8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103740:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103746:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103752:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103762:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966899.103765:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103808:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103817:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7f9310e (ffff9a04c3347300) 00010000:00010000:0.0:1783966899.103820:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966899.103823:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103828:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316067061 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7f9310e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103844:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103851:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103857:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103863:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966899.103865:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103871:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103888:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a04c1cc8300) 00010000:00010000:0.0:1783966899.103891:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966899.103894:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.103900:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606707d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966899.103921:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966899.103938:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587888128:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783966899.104008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966899.104065:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888128 00000100:00100000:0.0:1783966899.104072:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888128 00000100:00100000:0.0:1783966899.104122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783966899.104131:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587888128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783966899.104161:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1783966899.104906:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a552cad, atime: 0x6a552cad, ctime: 0x6a552cad, blocks: 0x0 00010000:00010000:0.0:1783966899.104917:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.104932:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1783966899.104938:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966899.104945:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.104960:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.104985:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.104994:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.105011:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783966899.106630:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587888128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2489us (2611us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783966899.106644:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1783966899.106689:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783966899.106697:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.106710:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966899.106715:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.106725:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.106745:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.106752:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b31606708b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966899.106814:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966899.106816:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966899.106818:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783966899.106862:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3c97b80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783966899.106868:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587888128:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783966899.256078:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966899.589482:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587888256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966899.589601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966899.593091:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888256 00000100:00100000:1.0:1783966899.593117:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888256 00000100:00100000:1.0:1783966899.593200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783966899.593215:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587888256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966899.593288:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966899.597745:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587888256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4517us (8128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966899.597790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783966899.599349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587888256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966900.283846:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783966900.557552:0:13733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd97bb2040 20000000:00000080:2.0:1783966900.557578:0:13733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05f7e24800 uarg=0000000000000000 20000000:01000000:2.0:1783966900.557637:0:13733:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783966900.557645:0:13733:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783966900.557652:0:13733:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783966900.559817:0:13734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783966900.560227:0:13733:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783966900.574463:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783966900.574527:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783966900.574560:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783966900.574584:0:13733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783966900.574617:0:13733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574648:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574658:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574667:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f26 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574675:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f34 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574684:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f42 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574720:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316066f50 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.574729:0:13733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576263:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576293:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 23 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.576320:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888384:0@lo:104: 00000100:00100000:3.0:1783966900.576438:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966900.576530:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576552:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 23 pid: 6512 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.576562:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888512:0@lo:104: 00010000:00010000:3.0:1783966900.576593:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576601:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 23 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.576609:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888640:0@lo:104: 00010000:00010000:3.0:1783966900.576633:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576662:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 23 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.576670:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888768:0@lo:104: 00010000:00010000:3.0:1783966900.576704:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.576715:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.576725:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888896:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966900.576735:0:9520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783966900.576782:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966900.576802:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966900.576815:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966900.576818:0:9520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783966900.576824:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 12 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966900.576828:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888384 00000100:00100000:3.0:1783966900.576832:0:13733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587889024:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966900.576836:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888384 00000100:00100000:3.0:1783966900.576858:0:13733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c550c180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966900.576890:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888512 00000100:00100000:1.0:1783966900.576894:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888512 00000100:00100000:1.0:1783966900.576905:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888640 00000100:00100000:1.0:1783966900.576913:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888640 00000100:00100000:1.0:1783966900.576939:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587888768 00000100:00100000:1.0:1783966900.576942:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587888768 00000100:00100000:1.0:1783966900.576959:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783966900.576968:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+6:13733:x1870624587888384:12345-0@lo:104: 00010000:00010000:1.0:1783966900.576983:0:9520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.577128:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966900.577141:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+6:13733:x1870624587888512:12345-0@lo:104: 00010000:00010000:2.0:1783966900.577151:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577225:0:9520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783966900.577232:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8e80b464-a486-4100-b63a-6e6116a9d437+6:13733:x1870624587888384:12345-0@lo:104: Request processed in 264us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966900.577240:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1783966900.577318:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783966900.577325:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+5:13733:x1870624587888512:12345-0@lo:104: Request processed in 188us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.577332:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783966900.577350:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783966900.577357:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:13733:x1870624587888640:12345-0@lo:104: 00010000:00010000:2.0:1783966900.577365:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.577412:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783966900.577418:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+4:13733:x1870624587888640:12345-0@lo:104: Request processed in 62us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.577425:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1783966900.577437:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1783966900.577446:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1783966900.577446:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.577457:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:13733:x1870624587888768:12345-0@lo:104: 00010000:00010000:1.0:1783966900.577458:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966900.577467:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.577470:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577490:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966900.577501:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966900.577509:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783966900.577510:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783966900.577517:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8e80b464-a486-4100-b63a-6e6116a9d437+3:13733:x1870624587888768:12345-0@lo:104: Request processed in 62us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.577524:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1783966900.577541:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783966900.577549:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.577557:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783966900.577557:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.577557:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783966900.577562:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577568:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783966900.577570:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783966900.577577:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966900.577583:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783966900.577600:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577605:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.577606:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966900.577613:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274e600/0x9269c8b316066f50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f57 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.577617:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.577623:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b316066f42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f49 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577630:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783966900.577633:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966900.577634:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.577635:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966900.577638:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966900.577640:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783966900.577643:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577650:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783966900.577657:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783966900.577662:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1783966900.577664:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587889152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783966900.577676:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577682:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783966900.577704:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966900.577708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966900.577711:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316066f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f2d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577721:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966900.577729:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966900.577732:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966900.577745:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587889280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783966900.577767:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889152 00000100:00100000:0.0:1783966900.577806:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889152 00000100:00100000:1.0:1783966900.577813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783966900.577830:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 24 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966900.577851:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587889408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783966900.577854:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889280 00000100:00100000:0.0:1783966900.577856:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889280 00010000:00010000:0.0:1783966900.577867:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 25 pid: 6512 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966900.577874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966900.577883:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889408 00000100:00100000:0.0:1783966900.577886:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889408 00010000:00010000:0.0:1783966900.577897:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 26 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966900.577904:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783966900.577912:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e80b464-a486-4100-b63a-6e6116a9d437+26:3645:x1870624587889152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783966900.577924:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966900.577941:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 26 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577954:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 26 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966900.577976:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966900.578005:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e80b464-a486-4100-b63a-6e6116a9d437+26:3645:x1870624587889152:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (297us total) trans 0 rc 0/0 00010000:00010000:3.0:1783966900.578069:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050c00/0x9269c8b316066f57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066f50 expref: 26 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.578081:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888384:0@lo:104: 00000100:00100000:3.0:1783966900.578092:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888512:0@lo:104: 00000100:00100000:3.0:1783966900.578099:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888640:0@lo:104: 00000100:00100000:3.0:1783966900.578105:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888768:0@lo:104: 00000100:00100000:3.0:1783966900.582847:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966900.582872:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966900.582945:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587888896:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966900.582960:0:13733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1870624587889024:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966900.586271:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966900.586297:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.586319:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966900.586325:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.586337:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966900.586347:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.586375:0:13733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966900.586392:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783966900.586711:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.586719:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966900.586760:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.586791:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316066f34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316066f3b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966900.586792:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587889536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966900.586825:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966900.586828:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966900.586830:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966900.586836:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966900.586839:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966900.586901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966900.589134:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686784 00000100:00100000:0.0:1783966900.589158:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686784 00000100:00100000:2.0:1783966900.589173:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563686912 00000100:00100000:2.0:1783966900.589180:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563686912 00010000:00010000:2.0:1783966900.589235:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 14 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.589257:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889536 00000100:00100000:2.0:1783966900.589259:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889536 00010000:00010000:2.0:1783966900.589270:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 26 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.589283:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783966900.589291:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+26:3646:x1870624587889280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966900.589312:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966900.589325:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 14 pid: 6511 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589343:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 26 pid: 6512 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966900.589347:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1783966900.589361:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 26 pid: 6512 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966900.589368:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1783966900.589386:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050400/0x9269c8b316066f49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066f42 expref: 26 pid: 6512 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966900.589405:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1783966900.589411:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966900.589547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+25:3646:x1870624587889280:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (11719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.589555:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783966900.589579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783966900.589586:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587889408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966900.589594:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966900.589599:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 24 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589609:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 24 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589620:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316066f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066f26 expref: 24 pid: 6511 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589632:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966900.589659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+23:3647:x1870624587889408:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (11784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.589666:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783966900.589684:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1783966900.589698:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961de9b-00b2-4d50-9cea-eabe4c7514df+14:2401:x1870624563686912:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966900.589710:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966900.589715:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 14 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589724:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 14 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589736:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274f800/0x9269c8b316066f18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b98 expref: 14 pid: 6512 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589745:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966900.589814:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563686912:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 117us (6941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966900.589822:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1783966900.589838:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783966900.589844:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+22:3648:x1870624587889536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966900.589853:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966900.589857:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 22 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589869:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 22 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966900.589880:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316066f3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316066f34 expref: 22 pid: 6510 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966900.589886:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00010000:00010000:2.0:1783966900.589896:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966900.589902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:2401:x1870624563686784:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966900.589914:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966900.589920:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.589933:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.589941:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+21:3648:x1870624587889536:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (3040us total) trans 0 rc 0/0 00010000:00010000:0.0:1783966900.589951:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631600/0x9269c8b316066f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b9f expref: 12 pid: 6511 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.589959:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1783966900.589977:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.589988:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966900.590027:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587889408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966900.590074:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587889152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783966900.591014:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783966900.591214:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587889280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783966900.591574:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587889536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783966900.591684:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591697:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591704:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591711:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591738:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966900.591743:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591753:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591797:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966900.591811:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966900.591876:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:2401:x1870624563686784:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1975us (9041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966900.591887:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00010000:00010000:3.0:1783966900.592829:0:13733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.592844:0:13733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966900.592853:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0c00/0x9269c8b316067092 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.304784:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783966901.545459:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb9d71490 20000000:00000080:3.0:1783966901.545478:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05f574bc00 uarg=0000000000000000 20000000:01000000:3.0:1783966901.545895:0:13784:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783966901.545902:0:13784:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783966901.545906:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1783966901.546629:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1783966901.547042:0:13784:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1783966901.547203:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1783966901.547238:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1783966901.547254:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1783966901.547265:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783966901.547287:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547319:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547330:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547337:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547344:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547350:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547356:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fe00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966901.547360:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547367:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547381:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547389:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.547394:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067099 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966901.636894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966901.636958:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687040 00000100:00100000:1.0:1783966901.636972:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687040 00000100:00100000:1.0:1783966901.637043:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 342 00000100:00100000:1.0:1783966901.637054:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:6175:x1870624563687040:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966901.637074:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966901.637094:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274fe00/0x9269c8b3160670a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bec expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.637125:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fe00/0x9269c8b3160670a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bec expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.637137:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274fe00/0x9269c8b3160670a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bec expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966901.637145:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fe00, rc 0) 00000100:00100000:1.0:1783966901.637208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687040:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 156us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966901.637217:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 342 00000100:00100000:1.0:1783966901.653578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.653675:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687168 00000100:00100000:3.0:1783966901.653687:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687168 00000100:00100000:3.0:1783966901.653749:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 343 00000100:00100000:3.0:1783966901.653838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687168:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966901.654030:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687168:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 228us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966901.654039:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 343 00000100:00100000:3.0:1783966901.662583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966901.662713:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687296 00000100:00100000:0.0:1783966901.662726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687296 00000100:00100000:0.0:1783966901.662813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 344 00000100:00100000:0.0:1783966901.662824:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687296:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966901.663024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687296:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 197us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966901.663033:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 344 00000100:00100000:0.0:1783966901.670872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.674910:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687424 00000100:00100000:3.0:1783966901.674927:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687424 00000100:00100000:3.0:1783966901.675152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 345 00000100:00100000:3.0:1783966901.675165:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:10785:x1870624563687424:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783966901.675329:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:10785:x1870624563687424:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 166us (4468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966901.675337:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 345 00000100:00100000:2.0:1783966901.680504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.680712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687552 00000100:00100000:3.0:1783966901.680722:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687552 00000100:00100000:3.0:1783966901.680808:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 346 00000100:00100000:3.0:1783966901.680819:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:10785:x1870624563687552:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783966901.682247:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:10785:x1870624563687552:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 1352us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966901.682261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 346 00000100:00100000:2.0:1783966901.702318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.702740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687680 00000100:00100000:3.0:1783966901.702752:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687680 00000100:00100000:3.0:1783966901.702850:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 347 00000100:00100000:3.0:1783966901.702861:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:6175:x1870624563687680:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966901.702880:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966901.702899:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0c00/0x9269c8b3160670a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bf3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966901.702954:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0c00/0x9269c8b3160670a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bf3 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966901.702968:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0c00/0x9269c8b3160670a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bf3 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966901.702978:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0c00, rc 0) 00000100:00100000:3.0:1783966901.703038:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563687680:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 179us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966901.703045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 347 00000100:00100000:2.0:1783966901.705573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.705705:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687808 00000100:00100000:3.0:1783966901.705715:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687808 00000100:00100000:2.0:1783966901.705941:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 348 00000100:00100000:2.0:1783966901.705952:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563687808:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966901.706121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563687808:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 171us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966901.706130:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 348 00000100:00100000:3.0:1783966901.708507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966901.708671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563687936 00000100:00100000:2.0:1783966901.708683:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563687936 00000100:00100000:2.0:1783966901.708752:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 349 00000100:00100000:2.0:1783966901.708763:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563687936:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966901.708963:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:6175:x1870624563687936:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 201us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966901.708971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 349 00000100:00100000:0.0:1783966901.719082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966901.719386:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688064 00000100:00100000:3.0:1783966901.719402:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688064 00000100:00100000:3.0:1783966901.719463:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 350 00000100:00100000:3.0:1783966901.719474:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:10788:x1870624563688064:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783966901.719657:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:10788:x1870624563688064:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 183us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966901.719666:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 350 00000100:00100000:3.0:1783966901.725440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966901.725583:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688192 00000100:00100000:1.0:1783966901.725595:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688192 00000100:00100000:1.0:1783966901.725655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 351 00000100:00100000:1.0:1783966901.725664:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:10788:x1870624563688192:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783966901.725858:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:10788:x1870624563688192:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 194us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966901.725866:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 351 00010000:00010000:1.0:1783966902.328646:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783966902.329334:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783966902.329340:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ef299800 from 7 10000000:01000000:0.0:1783966902.329346:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966902.329430:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.329443:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.329454:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966902.329481:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.329574:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.329704:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966902.344388:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889664 00000100:00100000:1.0:1783966902.344407:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889664 00000100:00100000:1.0:1783966902.344494:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1783966902.344513:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+20:6515:x1870624587889664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966902.344534:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966902.344556:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274f200/0x9269c8b3160670b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160670ae expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.344588:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274f200/0x9269c8b3160670b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160670ae expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.344601:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274f200/0x9269c8b3160670b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160670ae expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.344611:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f200, rc 0) 00000100:00100000:1.0:1783966902.344713:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587889664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (15138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966902.344720:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783966902.346071:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966902.346169:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.346182:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966902.347068:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.347206:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.347314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889792 00000100:00100000:0.0:1783966902.347317:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966902.347320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889792 00000100:00100000:3.0:1783966902.347371:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783966902.347384:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587889792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.347572:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587889792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966902.347595:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783966902.348525:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.348575:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.348632:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.348670:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966902.348734:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587889920 00000100:00100000:3.0:1783966902.348739:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587889920 00000100:00100000:3.0:1783966902.348824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783966902.348833:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587889920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.348945:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587889920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966902.348953:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1783966902.349034:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587889920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783966902.349570:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13798:1870624587890048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966902.349611:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966902.349643:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a6240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966902.349757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890048 00000100:00100000:2.0:1783966902.349763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890048 00000100:00100000:2.0:1783966902.349871:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1783966902.349881:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:13798:x1870624587890048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966902.350028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+21:13798:x1870624587890048:12345-0@lo:502:llog_process_th.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966902.350042:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1783966902.352926:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13798:1870624587890048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783966902.353069:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966902.353175:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.353179:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783966902.353188:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05ef299800 00000020:00000080:0.0:1783966902.353192:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783966902.353261:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966902.353266:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.353267:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783966902.353270:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966902.353272:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.353274:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783966902.353278:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05ef299800 00000020:00000080:0.0:1783966902.353280:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783966902.353335:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13798:1870624587890176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.353418:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.353463:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966902.354991:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890176 00000100:00100000:1.0:1783966902.355002:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890176 00000100:00100000:1.0:1783966902.355069:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783966902.355079:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:13798:x1870624587890176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783966902.355346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:13798:x1870624587890176:12345-0@lo:502:llog_process_th.0 Request processed in 268us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966902.355361:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1783966902.355950:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13798:1870624587890176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783966902.355989:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966902.355996:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.355998:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783966902.356002:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783966902.356329:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783966902.356355:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966902.356369:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.356381:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966902.356392:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783966902.356395:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff3800 from 7 10000000:01000000:3.0:1783966902.356398:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783966902.356432:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.356440:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.356450:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966902.356472:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.356536:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.356567:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966902.356698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890304 00000100:00100000:1.0:1783966902.356704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890304 00000100:00100000:3.0:1783966902.357251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783966902.357263:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+21:6515:x1870624587890304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783966902.357279:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966902.357294:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0200/0x9269c8b3160670c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160670bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.357319:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0200/0x9269c8b3160670c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160670bc expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.357330:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0200/0x9269c8b3160670c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160670bc expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.357339:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0200, rc 0) 00000100:00100000:3.0:1783966902.357397:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966902.357404:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783966902.360371:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966902.360404:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.360417:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966902.360512:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783966902.360578:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966902.360622:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a6600 going to sleep for 11 seconds 00000100:00100000:3.0:1783966902.361426:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890432 00000100:00100000:3.0:1783966902.361436:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890432 00000100:00100000:3.0:1783966902.361493:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783966902.361512:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.361665:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966902.361672:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1783966902.361717:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.361796:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.361863:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.361888:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.362061:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890560 00000100:00100000:0.0:1783966902.362066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890560 00000100:00100000:0.0:1783966902.362113:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1783966902.362121:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.362201:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.362208:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783966902.365584:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.366337:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13800:1870624587890688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966902.366423:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.366467:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.368162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890688 00000100:00100000:0.0:1783966902.368178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890688 00000100:00100000:0.0:1783966902.368250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1783966902.368262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:13800:x1870624587890688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.368438:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+22:13800:x1870624587890688:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.368446:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783966902.368899:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13800:1870624587890688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966902.368935:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966902.368946:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966902.368948:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783966902.368954:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05fcff3800 00000020:00000080:3.0:1783966902.368957:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783966902.369006:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966902.369009:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966902.369011:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783966902.369013:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783966902.369016:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966902.369018:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783966902.369021:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05fcff3800 00000020:00000080:3.0:1783966902.369023:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783966902.369067:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13800:1870624587890816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966902.369129:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.369163:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.369345:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890816 00000100:00100000:0.0:1783966902.369351:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890816 00000100:00100000:0.0:1783966902.369386:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1783966902.369395:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:13800:x1870624587890816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.369487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+22:13800:x1870624587890816:12345-0@lo:502:llog_process_th.0 Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.369494:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783966902.370968:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13800:1870624587890816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783966902.371008:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783966902.371017:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783966902.371019:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783966902.371031:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1783966902.371541:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1783966902.371576:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783966902.371588:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.371601:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783966902.371625:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783966902.371628:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f1a14000 from 7 10000000:01000000:0.0:1783966902.371631:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783966902.371664:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.371672:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.371689:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966902.371712:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.371807:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.372007:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699540 going to sleep for 11 seconds 00000100:00100000:1.0:1783966902.372431:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587890944 00000100:00100000:1.0:1783966902.372438:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587890944 00000100:00100000:1.0:1783966902.373996:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783966902.374014:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+22:6515:x1870624587890944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783966902.374032:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966902.374051:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274e600/0x9269c8b3160670d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160670ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.374080:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274e600/0x9269c8b3160670d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160670ca expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.374106:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274e600/0x9269c8b3160670d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160670ca expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.374115:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e600, rc 0) 00000100:00100000:1.0:1783966902.374192:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587890944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966902.374199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1783966902.376893:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587890944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966902.376922:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966902.376934:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966902.377019:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.377074:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966902.381981:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8600 going to sleep for 11 seconds 00000040:00080000:2.0:1783966902.383287:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783966902.386279:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891072 00000100:00100000:0.0:1783966902.386298:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891072 00000100:00100000:0.0:1783966902.386446:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1783966902.386459:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587891072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.386755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587891072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (9679us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.386763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1783966902.386836:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.386890:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.386960:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.386984:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699540 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.387015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891200 00000100:00100000:0.0:1783966902.387019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891200 00000100:00100000:0.0:1783966902.387036:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783966902.387042:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587891200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.387302:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587891200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.387310:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783966902.387419:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783966902.387701:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13803:1870624587891328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.387738:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.387761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891328 00000100:00100000:0.0:1783966902.387765:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891328 00000100:00100000:0.0:1783966902.387805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783966902.387811:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:13803:x1870624587891328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.387887:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:13803:x1870624587891328:12345-0@lo:502:llog_process_th.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.387947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783966902.387976:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699000 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.387989:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13803:1870624587891328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783966902.388009:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966902.388018:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.388020:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783966902.388027:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f1a14000 00000020:00000080:0.0:1783966902.388029:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783966902.388214:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966902.388743:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.388746:0:13803:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783966902.388751:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783966902.388755:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.388757:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783966902.388762:0:13803:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f1a14000 00000020:00000080:0.0:1783966902.388764:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783966902.389311:0:13803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13803:1870624587891456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783966902.389390:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.389432:0:13803:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699000 going to sleep for 11 seconds 00000100:00100000:3.0:1783966902.389566:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891456 00000100:00100000:3.0:1783966902.389572:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891456 00000100:00100000:3.0:1783966902.389607:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783966902.389615:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:13803:x1870624587891456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783966902.391937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+23:13803:x1870624587891456:12345-0@lo:502:llog_process_th.0 Request processed in 2311us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966902.391955:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1783966902.393849:0:13803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c95c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13803:1870624587891456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783966902.393897:0:13803:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783966902.393907:0:13803:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783966902.393909:0:13803:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783966902.393913:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783966902.394329:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783966902.394362:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783966902.394374:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.394386:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966902.394397:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783966902.394400:0:6515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05ed1cf800 from 7 10000000:01000000:3.0:1783966902.394403:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783966902.394436:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.394444:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966902.394454:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966902.394474:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783966902.394544:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966902.394586:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1783966902.395669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891584 00000100:00100000:0.0:1783966902.395680:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891584 00000100:00100000:0.0:1783966902.395744:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783966902.395753:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+23:6515:x1870624587891584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783966902.395782:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966902.395798:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0a00/0x9269c8b3160670df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160670d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.398762:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0a00/0x9269c8b3160670df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160670d8 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.398800:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0a00/0x9269c8b3160670df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160670d8 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966902.398813:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0a00, rc 0) 00000100:00100000:0.0:1783966902.398922:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587891584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3168us (4376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.398931:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1783966902.398991:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783966902.399017:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966902.399030:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966902.399204:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.399243:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966902.399324:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966902.399945:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891712 00000100:00100000:1.0:1783966902.399953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891712 00000100:00100000:2.0:1783966902.402582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1783966902.402605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587891712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.402859:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587891712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966902.402876:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1783966902.402941:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.403006:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.403065:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966902.403115:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783966902.403132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891840 00000100:00100000:2.0:1783966902.403138:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891840 00000100:00100000:2.0:1783966902.403171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783966902.403178:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587891840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.403259:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:6515:x1870624587891840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966902.403266:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1783966902.403303:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8e80b464-a486-4100-b63a-6e6116a9d437:6515:1870624587891840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783966902.403572:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13805:1870624587891968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966902.403605:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966902.403624:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587891968 00000100:00100000:2.0:1783966902.403627:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587891968 00000100:00100000:2.0:1783966902.403647:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1783966902.403654:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:13805:x1870624587891968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966902.403723:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:13805:x1870624587891968:12345-0@lo:502:llog_process_th.0 Request processed in 68us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966902.403730:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1783966902.403760:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966902.403804:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13805:1870624587891968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783966902.403843:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966902.403853:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966902.403856:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783966902.403862:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05ed1cf800 00000020:00000080:2.0:1783966902.403865:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783966902.403918:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966902.403922:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966902.403923:0:13805:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783966902.403931:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783966902.403933:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966902.403935:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783966902.403939:0:13805:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05ed1cf800 00000020:00000080:2.0:1783966902.403941:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783966902.403972:0:13805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13805:1870624587892096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966902.404005:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966902.404023:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892096 00000100:00100000:2.0:1783966902.404026:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892096 00000100:00100000:2.0:1783966902.404060:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1783966902.404067:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:13805:x1870624587892096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783966902.404130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:13805:x1870624587892096:12345-0@lo:502:llog_process_th.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966902.404137:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1783966902.404171:0:13805:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966902.404184:0:13805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8e80b464-a486-4100-b63a-6e6116a9d437:13805:1870624587892096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783966902.404200:0:13805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783966902.404205:0:13805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783966902.404206:0:13805:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783966902.404211:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1783966902.404874:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1783966902.404899:0:6515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783966902.404909:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966902.404921:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783966902.413714:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783966902.651687:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587892224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966902.651831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966902.652063:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892224 00000100:00100000:0.0:1783966902.652073:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892224 00000100:00100000:0.0:1783966902.652139:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783966902.652150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587892224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966902.652200:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966902.652288:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587892224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966902.652296:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783966902.652434:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587892224:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966903.351079:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966903.416064:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783966903.417384:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783966903.560041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966903.560103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966903.560130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966903.560162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966903.560189:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688704 00000100:00100000:0.0:1783966903.560199:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688704 00000100:00100000:0.0:1783966903.560257:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1783966903.560279:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563688704:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966903.560351:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563688704:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966903.560359:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:3.0:1783966903.560654:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688320 00000100:00100000:3.0:1783966903.560660:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688320 00000100:00100000:3.0:1783966903.560690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 372 00000100:00100000:3.0:1783966903.560698:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563688320:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966903.560726:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563688320:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966903.560733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 372 00000100:00080000:3.0:1783966903.560926:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966903.561271:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688448 00000100:00100000:2.0:1783966903.561277:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688448 00000100:00100000:2.0:1783966903.561327:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688960 00000100:00100000:2.0:1783966903.561331:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688960 00000100:00100000:2.0:1783966903.561356:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:2.0:1783966903.561365:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563688448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966903.561430:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563688448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 66us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966903.561437:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:2.0:1783966903.561451:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 242 00000100:00100000:2.0:1783966903.561457:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563688960:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966903.561494:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563688960:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966903.561501:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 242 00000100:00080000:2.0:1783966903.568951:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966903.568966:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966903.570618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966903.570668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966903.572404:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688576 00000100:00100000:2.0:1783966903.572419:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688576 00000100:00100000:2.0:1783966903.572524:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563688832 00000100:00100000:2.0:1783966903.572528:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563688832 00000100:00100000:2.0:1783966903.572570:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:2.0:1783966903.572583:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563688576:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966903.572702:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563688576:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 121us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966903.572711:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:2.0:1783966903.572731:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 244 00000100:00100000:2.0:1783966903.572738:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563688832:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966903.572764:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563688832:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966903.572793:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 244 00000100:00080000:0.0:1783966903.575141:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966903.575154:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966904.184101:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587892352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966904.184182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966904.184257:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892352 00000100:00100000:1.0:1783966904.184258:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587892864:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.184266:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892352 00000100:00100000:1.0:1783966904.184291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966904.184311:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587893376:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.184336:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783966904.184348:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587892352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966904.184357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966904.184375:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587893888:0@lo:400:kworker.0 00002000:00000024:0.0:1783966904.184392:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966904.184398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966904.184421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783966904.184427:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587892736:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.184457:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587892352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.184475:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966904.184480:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783966904.184507:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893376 00000100:00100000:1.0:1783966904.184512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587893248:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.184519:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893376 00000100:00100000:1.0:1783966904.184543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966904.184559:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587893760:0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.184589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966904.184862:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893888 00000100:00100000:0.0:1783966904.184867:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893888 00000100:00100000:0.0:1783966904.184890:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783966904.184898:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587893376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966904.185029:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587892608:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.185125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587892480:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.189818:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587893376:12345-0@lo:400:kworker.0 Request processed in 4911us (5451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.189923:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587892352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966904.189942:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966904.189951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783966904.189965:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587894272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966904.189995:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783966904.190011:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587893888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.190013:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966904.190075:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587893376:0@lo:400:kworker.0 00000100:00100000:0.0:1783966904.190085:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587893888:12345-0@lo:400:kworker.0 Request processed in 80us (5687us total) trans 0 rc 0/0 00010000:00080000:1.0:1783966904.190211:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e10000 x1870624587893888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966904.190223:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587893888:0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.190682:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892864 00000100:00100000:1.0:1783966904.190690:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892864 00000100:00100000:1.0:1783966904.190738:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893248 00000100:00100000:1.0:1783966904.190742:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893248 00000100:00100000:1.0:1783966904.190766:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893760 00000100:00100000:1.0:1783966904.190791:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893760 00000100:00100000:1.0:1783966904.190811:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783966904.190818:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587892864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.190863:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587892864:12345-0@lo:400:kworker.0 Request processed in 45us (6572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.190870:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783966904.190885:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783966904.190892:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587893248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.190923:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587893248:12345-0@lo:400:kworker.0 Request processed in 33us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.190930:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1783966904.190957:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783966904.190964:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587893760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.190996:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587893760:12345-0@lo:400:kworker.0 Request processed in 33us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.191002:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783966904.191029:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587894400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966904.191224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783966904.191343:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e13100 x1870624587893248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966904.191420:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587893248:0@lo:400:kworker.0 00010000:00080000:1.0:1783966904.191610:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e12680 x1870624587893760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966904.191632:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587893760:0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.191647:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587892864:0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.191708:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892736 00000100:00100000:1.0:1783966904.191713:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892736 00000100:00100000:1.0:1783966904.191747:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783966904.191754:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587892736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.191833:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587892736:12345-0@lo:400:kworker.0 Request processed in 78us (7370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966904.191840:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1783966904.191862:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783966904.191868:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966904.191870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966904.191895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587892736:0@lo:400:kworker.0 00000100:00100000:1.0:1783966904.191932:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894272 00000100:00100000:1.0:1783966904.191937:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894272 00000100:00100000:1.0:1783966904.191962:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894400 00000100:00100000:1.0:1783966904.191965:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894400 00000100:00100000:1.0:1783966904.192347:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966904.193054:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783966904.193266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966904.193322:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587893120:0@lo:400:kworker.0 00000100:00100000:3.0:1783966904.193365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966904.193386:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587893632:0@lo:400:kworker.0 00000100:00100000:3.0:1783966904.193407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966904.193418:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587894144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966904.193450:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966904.193488:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894144 00000100:00100000:3.0:1783966904.193493:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894144 00000100:00100000:1.0:1783966904.193802:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587894272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783966904.193836:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966904.193889:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587894272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.193986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966904.194021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587892992:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966904.194069:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587893504:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194103:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966904.194123:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587894016:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966904.194177:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892480 00000100:00100000:2.0:1783966904.194182:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892480 00000100:00100000:2.0:1783966904.194225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1783966904.194233:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587892480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194275:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587892480:12345-0@lo:400:kworker.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.194282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1783966904.194323:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892608 00000100:00100000:2.0:1783966904.194339:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892608 00000100:00100000:2.0:1783966904.194366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893120 00000100:00100000:2.0:1783966904.194368:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893120 00000100:00100000:2.0:1783966904.194383:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893632 00000100:00100000:2.0:1783966904.194386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893632 00000100:00100000:2.0:1783966904.194399:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783966904.194405:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587892608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194457:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587892608:12345-0@lo:400:kworker.0 Request processed in 51us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.194473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1783966904.194485:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783966904.194491:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587893120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194731:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587893120:12345-0@lo:400:kworker.0 Request processed in 239us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.194743:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1783966904.194756:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783966904.194762:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587893632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194853:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587893632:12345-0@lo:400:kworker.0 Request processed in 91us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.194860:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783966904.194901:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587892480:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.194938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587892992 00000100:00100000:2.0:1783966904.194942:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587892992 00000100:00100000:2.0:1783966904.194969:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783966904.194976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587892992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195015:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587892992:12345-0@lo:400:kworker.0 Request processed in 40us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.195028:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783966904.195058:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587892992:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195084:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587892608:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195095:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587893120:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195105:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587893632:0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195125:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587893504 00000100:00100000:2.0:1783966904.195129:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587893504 00000100:00100000:2.0:1783966904.195147:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894016 00000100:00100000:2.0:1783966904.195149:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894016 00000100:00100000:2.0:1783966904.195160:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783966904.195165:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587893504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195205:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587893504:12345-0@lo:400:kworker.0 Request processed in 38us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.195211:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783966904.195222:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783966904.195228:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966904.195253:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587894016:12345-0@lo:400:kworker.0 Request processed in 26us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966904.195260:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783966904.195282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587893504:0@lo:400:kworker.0 00010000:00080000:2.0:1783966904.196187:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e11880 x1870624587894016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966904.196204:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587894016:0@lo:400:kworker.0 00000100:00080000:2.0:1783966904.196331:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966904.196339:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966904.196342:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783966904.196432:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ace00 x1870624587894272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966904.196451:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587894272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966904.206723:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783966904.206754:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587894400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966904.206800:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966904.207859:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587894400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1099us (16612us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966904.207873:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783966904.207895:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587894400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966904.208014:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783966904.208039:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783966904.208056:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587894144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966904.208078:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966904.208145:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587894144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (14693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966904.208168:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1783966904.209714:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3cf7480 x1870624587894144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966904.210002:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587894144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783966904.375269:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966904.698124:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966904.698159:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587894528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966904.698245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966904.699235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894528 00000100:00100000:3.0:1783966904.699246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894528 00000100:00100000:3.0:1783966904.699445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783966904.699466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587894528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966904.699506:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966904.700512:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587894528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1052us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966904.700523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000001:00080000:1.0:1783966904.700676:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1783966904.701058:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587894528:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966905.399423:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966906.423299:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966907.446955:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966907.773325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587894656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966907.773405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966907.773481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894656 00000100:00100000:3.0:1783966907.773491:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894656 00000100:00100000:3.0:1783966907.773561:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783966907.773571:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587894656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966907.773615:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966907.773683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587894656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966907.773760:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587894656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966907.782636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00010000:2.0:1783966908.471952:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966908.679602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966908.679651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966908.679690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966908.679718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966908.679743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966908.679753:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689344 00000100:00100000:1.0:1783966908.679766:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689344 00000100:00100000:3.0:1783966908.679814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966908.679874:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689600 00000100:00100000:1.0:1783966908.679878:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689600 00000100:00100000:1.0:1783966908.679892:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689216 00000100:00100000:1.0:1783966908.679894:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689216 00000100:00100000:1.0:1783966908.679908:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689728 00000100:00100000:1.0:1783966908.679910:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689728 00000100:00100000:1.0:1783966908.679928:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:1.0:1783966908.679938:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689344:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966908.680005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 252 00000100:00100000:3.0:1783966908.680019:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563689600:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966908.680022:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689344:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966908.680050:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:1.0:1783966908.680069:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:3.0:1783966908.680077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563689600:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 62us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966908.680079:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689216:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966908.680097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 252 00000100:00100000:1.0:1783966908.680111:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689216:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966908.680119:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:3.0:1783966908.680126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 254 00000100:00100000:3.0:1783966908.680138:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563689728:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966908.680247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563689728:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966908.680256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 254 00000100:00100000:2.0:1783966908.680565:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689088 00000100:00100000:2.0:1783966908.680571:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689088 00000100:00100000:2.0:1783966908.680626:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 374 00000100:00100000:2.0:1783966908.680634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563689088:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966908.680676:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563689088:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 43us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966908.680682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 374 00000100:00100000:2.0:1783966908.680723:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689472 00000100:00100000:2.0:1783966908.680727:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689472 00000100:00100000:2.0:1783966908.680766:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:2.0:1783966908.680827:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689472:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966908.680872:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689472:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 49us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966908.680886:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00080000:2.0:1783966908.680905:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966908.680909:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966908.680911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966909.303088:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966909.303120:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587894784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966909.303233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966909.303450:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894784 00000100:00100000:1.0:1783966909.303459:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894784 00000100:00100000:1.0:1783966909.303536:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783966909.303548:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587894784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966909.303579:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966909.303630:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587894784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.303637:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783966909.303861:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966909.303873:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587894912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966909.303907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783966909.304098:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966909.304137:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587894784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966909.304269:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587895040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966909.304298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966909.304327:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966909.304332:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587895168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966909.304355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966909.304435:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587894912 00000100:00100000:1.0:1783966909.304440:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587894912 00000100:00100000:1.0:1783966909.304474:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895040 00000100:00100000:1.0:1783966909.304476:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895040 00000100:00100000:1.0:1783966909.304488:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895168 00000100:00100000:1.0:1783966909.304490:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895168 00000100:00100000:1.0:1783966909.304502:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783966909.304507:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587894912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783966909.304530:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966909.304576:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587894912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.304584:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783966909.304613:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783966909.304619:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587895040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783966909.304628:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966909.304657:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587895040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.304663:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783966909.304673:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783966909.304678:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587895168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783966909.304687:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966909.304712:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587895168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.304718:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1783966909.304844:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966909.304847:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783966909.304913:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ace00 x1870624587894912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966909.304929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587894912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966909.304953:0:3647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1783966909.304957:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3c97b80, transno 4294967301 00000100:00100000:2.0:1783966909.304979:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587895168:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1783966909.304992:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04380 x1870624587895040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966909.305003:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587895040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966909.306098:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587895552:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.306150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.306254:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587895424:0@lo:400:kworker.0 00000100:00100000:3.0:1783966909.306287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.306315:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587895936:0@lo:400:kworker.0 00000100:00100000:3.0:1783966909.306336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.306376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783966909.306383:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587895296:0@lo:400:kworker.0 00000100:00100000:3.0:1783966909.306533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966909.306583:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587895680:0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.306616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966909.306645:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587896192:0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.306669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966909.306709:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895424 00000100:00100000:0.0:1783966909.306717:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895424 00000100:00100000:0.0:1783966909.306797:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895936 00000100:00100000:0.0:1783966909.306801:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895936 00000100:00100000:0.0:1783966909.306825:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895680 00000100:00100000:0.0:1783966909.306828:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895680 00000100:00100000:0.0:1783966909.306839:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896192 00000100:00100000:0.0:1783966909.306842:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896192 00000100:00100000:0.0:1783966909.306858:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783966909.306866:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587895424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.306922:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587895424:12345-0@lo:400:kworker.0 Request processed in 56us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966909.306930:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783966909.306964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783966909.306971:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587895936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.306997:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587895936:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966909.307003:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783966909.307015:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783966909.307020:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587895680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.307049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587895680:12345-0@lo:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966909.307054:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783966909.307065:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783966909.307071:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587896192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.307108:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587896192:12345-0@lo:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966909.307115:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783966909.307157:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587895680:0@lo:400:kworker.0 00000100:00100000:3.0:1783966909.307577:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587895808:0@lo:400:kworker.0 00000100:00080000:3.0:1783966909.307619:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966909.307901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895296 00000100:00100000:1.0:1783966909.307907:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895296 00000100:00100000:1.0:1783966909.307943:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1783966909.307951:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587895296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966909.307994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587895296:12345-0@lo:400:kworker.0 Request processed in 45us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.308002:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783966909.308276:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587896064:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.308317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966909.308381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.309060:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895552 00000100:00100000:3.0:1783966909.309067:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895552 00000100:00100000:3.0:1783966909.309121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783966909.309130:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587895552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966909.309266:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896064 00000100:00100000:1.0:1783966909.309270:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896064 00000100:00100000:1.0:1783966909.309307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1783966909.309315:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587896064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966909.309383:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587896064:12345-0@lo:400:kworker.0 Request processed in 69us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.309390:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783966909.309520:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587896320:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.309551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.310571:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587895552:12345-0@lo:400:kworker.0 Request processed in 1438us (4416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966909.310582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783966909.310611:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587895808 00000100:00100000:3.0:1783966909.310618:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587895808 00000100:00100000:3.0:1783966909.310643:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783966909.310651:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587895808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966909.310693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587895808:12345-0@lo:400:kworker.0 Request processed in 43us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966909.310699:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1783966909.310722:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966909.310790:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587895552:0@lo:400:kworker.0 00010000:00080000:3.0:1783966909.310807:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c94e00 x1870624587896064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966909.310816:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587896064:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.311104:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587895424:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.311117:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587895936:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.311136:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587895296:0@lo:400:kworker.0 00000100:00100000:2.0:1783966909.311147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587895808:0@lo:400:kworker.0 00000100:00100000:0.0:1783966909.311365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587896192:0@lo:400:kworker.0 00000100:00100000:1.0:1783966909.311859:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896320 00000100:00100000:1.0:1783966909.311866:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896320 00000100:00100000:1.0:1783966909.311923:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1783966909.311931:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587896320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966909.311992:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587896320:12345-0@lo:400:kworker.0 Request processed in 62us (2439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966909.311999:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:2.0:1783966909.312098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7dfd880 x1870624587896320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966909.312111:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587896320:0@lo:400:kworker.0 00000100:00080000:2.0:1783966909.313322:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783966909.495330:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966909.816604:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966909.816632:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587896448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966909.816722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966909.817077:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896448 00000100:00100000:3.0:1783966909.817085:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896448 00000100:00100000:3.0:1783966909.817142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783966909.817151:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587896448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966909.817186:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966909.817246:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587896448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966909.817264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783966909.819485:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587896448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966910.519947:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966911.544011:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966912.566934:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966912.887237:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966912.887264:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587896576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966912.887347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966912.888170:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896576 00000100:00100000:1.0:1783966912.888182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896576 00000100:00100000:1.0:1783966912.888248:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783966912.888258:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587896576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966912.888314:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966912.888387:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587896576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966912.888395:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783966912.888535:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587896576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783966913.591000:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966913.655936:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783966913.656149:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783966913.800452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966913.800502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966913.800564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966913.800658:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689856 00000100:00100000:2.0:1783966913.800669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689856 00000100:00100000:0.0:1783966913.800728:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690112 00000100:00100000:2.0:1783966913.800732:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 376 00000100:00100000:0.0:1783966913.800732:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690112 00000100:00100000:2.0:1783966913.800742:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563689856:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966913.800804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563689984 00000100:00100000:0.0:1783966913.800807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563689984 00000100:00100000:0.0:1783966913.800825:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 261 00000100:00100000:0.0:1783966913.800832:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563690112:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966913.800847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563689856:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 107us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966913.800855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 376 00000100:00100000:0.0:1783966913.800862:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563690112:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966913.800868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 261 00000100:00100000:0.0:1783966913.800880:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 262 00000100:00100000:0.0:1783966913.800885:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689984:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:2.0:1783966913.800897:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966913.800901:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966913.800906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563689984:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966913.800912:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 262 00000100:00100000:0.0:1783966913.818151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966913.818223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966913.818258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966913.818461:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690240 00000100:00100000:1.0:1783966913.818466:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690368 00000100:00100000:2.0:1783966913.818478:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690240 00000100:00100000:1.0:1783966913.818486:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690368 00000100:00100000:2.0:1783966913.818585:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:2.0:1783966913.818600:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563690240:12345-192.168.204.59@tcp:9:kworker.0 00000100:00100000:1.0:1783966913.818605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690496 00000100:00100000:1.0:1783966913.818612:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690496 00000020:00000080:2.0:1783966913.818644:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067006 00000100:00100000:1.0:1783966913.818653:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 263 00000100:00080000:2.0:1783966913.818658:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc4000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783966913.818669:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563690368:12345-192.168.204.59@tcp:400:kworker.0 00000001:00000004:2.0:1783966913.818723:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1783966913.818833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563690368:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 105us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966913.818842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 263 00000100:00100000:1.0:1783966913.818861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 264 00000100:00100000:1.0:1783966913.818869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563690496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966913.818901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563690496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966913.818908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 264 00010000:00010000:1.0:1783966913.818934:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966913.819029:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+2:2399:x1870624563690240:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 430us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966913.819040:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00080000:0.0:1783966913.819431:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966913.819438:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966913.819442:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966914.423194:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966914.423228:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587896704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966914.423340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966914.423483:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896704 00000100:00100000:2.0:1783966914.423493:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896704 00000100:00100000:2.0:1783966914.423566:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966914.423578:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587896704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966914.423620:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966914.423676:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587896704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966914.423683:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966914.423738:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587896704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966914.423986:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966914.423998:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587896832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966914.424039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.424073:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896832 00000100:00100000:0.0:1783966914.424078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896832 00000100:00100000:0.0:1783966914.424110:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783966914.424117:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587896832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966914.424135:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966914.424173:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587896832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.424180:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1783966914.424198:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966914.424202:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783966914.424223:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e11880 x1870624587896832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966914.424238:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587896832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966914.425612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587897344:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.425693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966914.425728:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587897856:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.425758:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966914.425822:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783966914.425828:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587896960:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426034:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897344 00000100:00100000:0.0:1783966914.426042:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897344 00000100:00100000:0.0:1783966914.426118:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783966914.426129:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587897344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426187:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587897344:12345-0@lo:400:kworker.0 Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.426194:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783966914.426232:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966914.426251:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587898368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966914.426294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426326:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898368 00000100:00100000:0.0:1783966914.426330:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898368 00000100:00100000:0.0:1783966914.426371:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783966914.426377:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587898368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966914.426398:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966914.426437:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587898368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.426444:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1783966914.426461:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966914.426517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587898368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966914.426552:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587897088:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426597:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587897600:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426618:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587898112:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426655:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426673:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966914.426680:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587897216:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426708:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426736:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587897728:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426802:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587898240:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.426826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966914.426981:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897088 00000100:00100000:0.0:1783966914.426986:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897088 00000100:00100000:0.0:1783966914.427009:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897600 00000100:00100000:0.0:1783966914.427012:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897600 00000100:00100000:0.0:1783966914.427028:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898112 00000100:00100000:0.0:1783966914.427031:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898112 00000100:00100000:0.0:1783966914.427044:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897728 00000100:00100000:0.0:1783966914.427047:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897728 00000100:00100000:0.0:1783966914.427062:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783966914.427069:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587897088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427108:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587897088:12345-0@lo:400:kworker.0 Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.427115:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783966914.427129:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783966914.427135:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587897600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427163:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587897600:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.427169:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783966914.427179:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783966914.427185:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587898112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427213:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587898112:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.427220:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783966914.427230:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783966914.427236:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587897728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427265:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587897728:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.427291:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:0.0:1783966914.427308:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966914.427310:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783966914.427333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3d04380 x1870624587897728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966914.427345:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587897728:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427357:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587897088:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427366:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587897600:0@lo:400:kworker.0 00010000:00080000:0.0:1783966914.427376:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c3722d80 x1870624587898112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966914.427383:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587898112:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.427429:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897216 00000100:00100000:0.0:1783966914.427433:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897216 00000100:00100000:0.0:1783966914.427458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783966914.427464:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587897216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.427617:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966914.427652:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587897472:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.427680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966914.427694:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587897984:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.427719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966914.427747:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587897344:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.427788:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897984 00000100:00100000:3.0:1783966914.427792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897984 00000100:00100000:3.0:1783966914.427826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783966914.429071:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587897216:12345-0@lo:400:kworker.0 Request processed in 1602us (2357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.429084:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783966914.429114:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897472 00000100:00100000:0.0:1783966914.429121:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897472 00000100:00100000:0.0:1783966914.429148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783966914.429155:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587897472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.429198:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587897472:12345-0@lo:400:kworker.0 Request processed in 43us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.429227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783966914.429302:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587897216:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.429372:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587896960 00000100:00100000:0.0:1783966914.429376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587896960 00000100:00100000:0.0:1783966914.429405:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1783966914.429411:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587896960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.429447:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587896960:12345-0@lo:400:kworker.0 Request processed in 36us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966914.429454:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1783966914.429899:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587897984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.429944:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587897984:12345-0@lo:400:kworker.0 Request processed in 55us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966914.429952:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:3.0:1783966914.429987:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966914.430025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587896960:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.430040:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587897472:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.430052:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587897984:0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.430112:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587897856 00000100:00100000:3.0:1783966914.430128:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587897856 00000100:00100000:3.0:1783966914.430163:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898240 00000100:00100000:3.0:1783966914.430166:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898240 00000100:00100000:3.0:1783966914.430212:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783966914.430219:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587897856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.430261:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587897856:12345-0@lo:400:kworker.0 Request processed in 42us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966914.430268:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783966914.430291:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783966914.430297:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966914.430331:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587898240:12345-0@lo:400:kworker.0 Request processed in 35us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966914.430337:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783966914.430351:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966914.430371:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587897856:0@lo:400:kworker.0 00010000:00080000:3.0:1783966914.430415:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c3723480 x1870624587898240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966914.430427:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587898240:0@lo:400:kworker.0 00000100:00100000:0.0:1783966914.432967:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587898496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966914.433057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966914.433222:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898496 00000100:00100000:2.0:1783966914.433235:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898496 00000100:00100000:2.0:1783966914.433313:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783966914.433343:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587898496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966914.433381:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966914.433460:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587898496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966914.433469:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1783966914.433566:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c94700 x1870624587898496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966914.433589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587898496:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1783966914.615040:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966914.937371:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587898624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966914.937489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966914.937872:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898624 00000100:00100000:1.0:1783966914.937889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898624 00000100:00100000:1.0:1783966914.937960:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783966914.937972:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587898624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966914.938024:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966914.938089:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587898624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966914.938097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783966914.938851:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587898624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783966915.638998:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966916.663103:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966917.687263:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966918.007171:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966918.007222:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587898752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966918.007311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966918.007467:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898752 00000100:00100000:1.0:1783966918.007478:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898752 00000100:00100000:1.0:1783966918.007549:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783966918.007560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587898752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966918.007606:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966918.007684:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587898752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966918.007692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783966918.008014:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587898752:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966918.710941:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966918.913302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966918.913364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966918.913415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966918.913583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690880 00000100:00100000:0.0:1783966918.913596:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690880 00000100:00100000:0.0:1783966918.913687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691136 00000100:00100000:0.0:1783966918.913691:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691136 00000100:00100000:0.0:1783966918.913718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 271 00000100:00100000:0.0:1783966918.913729:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563690880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966918.913863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563690880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 136us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966918.913892:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 271 00000100:00100000:0.0:1783966918.913912:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 272 00000100:00100000:0.0:1783966918.913919:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563691136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966918.913947:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563691136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966918.913954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 272 00000100:00100000:1.0:1783966918.914363:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690624 00000100:00100000:1.0:1783966918.914371:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690624 00000100:00100000:1.0:1783966918.914423:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 378 00000100:00100000:1.0:1783966918.914433:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563690624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966918.914477:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563690624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 47us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966918.914484:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 378 00000100:00080000:2.0:1783966918.914742:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966918.918062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966918.918121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966918.918308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563690752 00000100:00100000:1.0:1783966918.918320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563690752 00000100:00100000:1.0:1783966918.918409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691008 00000100:00100000:1.0:1783966918.918412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691008 00000100:00100000:1.0:1783966918.918437:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 273 00000100:00100000:1.0:1783966918.918447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563690752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966918.918553:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563690752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 108us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966918.918562:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 273 00000100:00100000:1.0:1783966918.918580:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 274 00000100:00100000:1.0:1783966918.918586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563691008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966918.918626:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563691008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 40us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966918.918632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 274 00000100:00080000:0.0:1783966918.919912:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966919.543051:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587898880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966919.543163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.543584:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966919.543596:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587899008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966919.543632:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966919.544092:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587898880 00000100:00100000:1.0:1783966919.544110:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587898880 00000100:00100000:1.0:1783966919.544213:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899008 00000100:00100000:1.0:1783966919.544219:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899008 00000100:00100000:2.0:1783966919.544301:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783966919.544322:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587898880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966919.544373:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966919.544407:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783966919.544424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587899008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966919.544444:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587898880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.544455:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00002000:00000024:1.0:1783966919.544458:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783966919.544623:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966919.544649:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587899392:0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.544697:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587899136:0@lo:400:kworker.0 00000100:00100000:3.0:1783966919.544864:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587899264:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.558922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.559008:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587899904:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.559055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.559080:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587900416:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.559147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.559331:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899392 00000100:00100000:0.0:1783966919.559344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899392 00000100:00100000:0.0:1783966919.559430:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783966919.559444:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587899392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.559541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587899392:12345-0@lo:400:kworker.0 Request processed in 100us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.559558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783966919.559896:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587899520:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.559933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.559970:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587900032:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.559997:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.560023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587900544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966919.560049:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.560118:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899904 00000100:00100000:0.0:1783966919.560195:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899904 00000100:00100000:0.0:1783966919.560238:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900416 00000100:00100000:0.0:1783966919.560241:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900416 00000100:00100000:0.0:1783966919.560258:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899520 00000100:00100000:0.0:1783966919.560261:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899520 00000100:00100000:0.0:1783966919.560276:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783966919.560283:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587899904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560324:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587899904:12345-0@lo:400:kworker.0 Request processed in 41us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.560332:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1783966919.560345:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783966919.560351:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587900416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560376:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587900416:12345-0@lo:400:kworker.0 Request processed in 26us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.560382:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1783966919.560392:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1783966919.560397:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587899520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560442:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587899520:12345-0@lo:400:kworker.0 Request processed in 44us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.560449:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1783966919.560487:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966919.560522:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587899520:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560682:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900032 00000100:00100000:0.0:1783966919.560687:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900032 00000100:00100000:0.0:1783966919.560722:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783966919.560728:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587900032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560765:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587900032:12345-0@lo:400:kworker.0 Request processed in 37us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.560814:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1783966919.560853:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966919.560874:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587900032:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.560905:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900544 00000100:00100000:0.0:1783966919.560909:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900544 00000100:00100000:0.0:1783966919.560958:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783966919.560965:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587900544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966919.560990:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966919.561030:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587900544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.561037:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1783966919.561054:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783966919.561125:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587900544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966919.563266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966919.563344:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587899648:0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.563388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966919.563407:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587900160:0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.563427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966919.563458:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900160 00000100:00100000:2.0:1783966919.563465:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900160 00000100:00100000:2.0:1783966919.563550:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783966919.563558:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587900160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.563615:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587900160:12345-0@lo:400:kworker.0 Request processed in 58us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.563622:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783966919.563671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587900160:0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.563712:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587900672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966919.563740:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.570470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899136 00000100:00100000:0.0:1783966919.570551:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899136 00000100:00100000:2.0:1783966919.571032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966919.571112:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587899776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.571158:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1783966919.571166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966919.571192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587899136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.571223:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899264 00000100:00100000:2.0:1783966919.571233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899264 00000100:00100000:0.0:1783966919.571309:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587899136:12345-0@lo:400:kworker.0 Request processed in 134us (8053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.571310:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899776 00000100:00100000:2.0:1783966919.571317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899776 00000100:00100000:0.0:1783966919.571329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1783966919.571387:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783966919.571399:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587899264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.571448:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900672 00000100:00100000:0.0:1783966919.571455:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900672 00000100:00100000:2.0:1783966919.571467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587899264:12345-0@lo:400:kworker.0 Request processed in 68us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.571477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783966919.571507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1783966919.571515:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587899776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.571964:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587899776:12345-0@lo:400:kworker.0 Request processed in 448us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.571973:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783966919.571988:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1783966919.571994:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587900672:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783966919.572022:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:0.0:1783966919.572022:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966919.572087:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587900672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (8344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.572090:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587899776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.572105:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783966919.572114:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587900288:0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.572161:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1783966919.572209:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:0.0:1783966919.572217:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a04c3cc7800/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000100:00100000:2.0:1783966919.572222:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900288 00000100:00100000:2.0:1783966919.572229:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900288 00000100:00100000:0.0:1783966919.572260:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587899648 00000100:00100000:0.0:1783966919.572268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587899648 00000100:00100000:0.0:1783966919.572299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783966919.572306:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587899648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966919.572356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587899648:12345-0@lo:400:kworker.0 Request processed in 49us (8967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966919.572363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783966919.572439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783966919.572447:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587900288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966919.572497:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587900288:12345-0@lo:400:kworker.0 Request processed in 50us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966919.572504:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000020:00000080:2.0:1783966919.572657:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3cc7800/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-OST0000 00000100:00100000:3.0:1783966919.574545:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587900288:0@lo:400:kworker.0 00000100:00100000:3.0:1783966919.574600:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587899264:0@lo:400:kworker.0 00000100:00100000:3.0:1783966919.574704:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587900672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966919.574721:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587899136:0@lo:400:kworker.0 00000100:00100000:3.0:1783966919.574734:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587899648:0@lo:400:kworker.0 00000100:00080000:3.0:1783966919.574792:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966919.575041:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587899008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30612us (31397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966919.575059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:3.0:1783966919.575230:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ace00 x1870624587899008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966919.575254:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587899008:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783966919.575280:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3c94e00 x1870624587898880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966919.575297:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587898880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966919.575334:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587899392:0@lo:400:kworker.0 00010000:00080000:3.0:1783966919.575350:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7dfc380 x1870624587899904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966919.575360:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587899904:0@lo:400:kworker.0 00010000:00080000:3.0:1783966919.575374:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7dfc000 x1870624587900416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966919.575382:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587900416:0@lo:400:kworker.0 00000020:00000080:2.0:1783966919.582948:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3cc4000 for lustre-OST0000 00010000:00010000:2.0:1783966919.738006:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966920.055204:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966920.055238:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587900800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966920.055337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966920.057147:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900800 00000100:00100000:1.0:1783966920.057176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900800 00000100:00100000:1.0:1783966920.057347:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783966920.057359:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587900800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966920.057424:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783966920.057565:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587900800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 207us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966920.057573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783966920.057690:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587900800:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966920.759590:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966921.782994:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966922.809455:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966923.128204:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966923.128231:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587900928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966923.128308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966923.128743:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587900928 00000100:00100000:0.0:1783966923.128751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587900928 00000100:00100000:0.0:1783966923.128837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783966923.128846:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587900928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966923.128880:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966923.128926:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587900928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966923.128932:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783966923.129081:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587900928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966923.832642:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966923.896609:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783966923.897479:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783966924.032737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966924.032796:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691264 00000100:00100000:0.0:1783966924.032807:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691264 00000100:00100000:0.0:1783966924.033236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 380 00000100:00100000:0.0:1783966924.033249:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563691264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966924.033331:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563691264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 85us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966924.033339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 380 00000100:00100000:1.0:1783966924.038890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966924.038982:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966924.048795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966924.052225:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691520 00000100:00100000:3.0:1783966924.052251:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691520 00000100:00100000:3.0:1783966924.052350:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691392 00000100:00100000:3.0:1783966924.052355:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691392 00000100:00100000:3.0:1783966924.052386:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:3.0:1783966924.052397:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563691520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966924.052484:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563691520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 89us (13606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966924.052491:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 281 00000100:00100000:3.0:1783966924.052508:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 282 00000100:00100000:3.0:1783966924.052514:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563691392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966924.052537:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563691392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (13555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966924.052543:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 282 00000100:00080000:3.0:1783966924.052563:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966924.052567:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966924.053220:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691648 00000100:00100000:1.0:1783966924.053233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691648 00000100:00100000:1.0:1783966924.053276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00100000:1.0:1783966924.053283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563691648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966924.053321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563691648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 38us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966924.053327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 283 00000100:00080000:1.0:1783966924.053342:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966924.053384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966924.053608:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691776 00000100:00100000:1.0:1783966924.053612:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691776 00000100:00100000:1.0:1783966924.053644:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 284 00000100:00100000:1.0:1783966924.053650:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563691776:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966924.053680:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2401:x1870624563691776:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966924.053687:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 284 00000100:00080000:1.0:1783966924.053704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966924.663052:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783966924.663075:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587901056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966924.663153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966924.663226:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901056 00000100:00100000:0.0:1783966924.663235:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901056 00000100:00100000:0.0:1783966924.663304:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783966924.663313:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587901056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966924.663343:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966924.663388:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587901056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966924.663395:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1783966924.663439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587901056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783966924.663512:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966924.664256:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587901184:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587901696:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664358:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664375:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587902208:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664431:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587902720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966924.664466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664490:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783966924.664496:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587901312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664533:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587901824:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664565:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587902336:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664612:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901184 00000100:00100000:2.0:1783966924.664617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901184 00000100:00100000:2.0:1783966924.664652:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1783966924.664660:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587901184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664700:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3647:x1870624587901184:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.664708:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1783966924.664737:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587901568:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664759:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664794:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587902080:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664813:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587902592:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664865:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1783966924.664870:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587901440:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664917:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587901952:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664945:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587902464:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.664963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.664989:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902208 00000100:00100000:2.0:1783966924.664993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902208 00000100:00100000:2.0:1783966924.665024:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901312 00000100:00100000:2.0:1783966924.665027:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901312 00000100:00100000:2.0:1783966924.665040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901824 00000100:00100000:2.0:1783966924.665042:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901824 00000100:00100000:2.0:1783966924.665053:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902336 00000100:00100000:2.0:1783966924.665055:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902336 00000100:00100000:2.0:1783966924.665066:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901568 00000100:00100000:2.0:1783966924.665068:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901568 00000100:00100000:2.0:1783966924.665091:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901952 00000100:00100000:2.0:1783966924.665094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901952 00000100:00100000:2.0:1783966924.665113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1783966924.665119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587902208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665153:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587902208:12345-0@lo:400:kworker.0 Request processed in 34us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1783966924.665173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783966924.665179:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587901312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665206:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587901312:12345-0@lo:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665211:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783966924.665222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1783966924.665235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587901824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587901824:12345-0@lo:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1783966924.665283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783966924.665288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587902336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587902336:12345-0@lo:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783966924.665330:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783966924.665335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587901568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665367:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587901568:12345-0@lo:400:kworker.0 Request processed in 32us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783966924.665383:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783966924.665389:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587901952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587901952:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783966924.665440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901696 00000100:00100000:2.0:1783966924.665443:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901696 00000100:00100000:2.0:1783966924.665460:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587901440 00000100:00100000:2.0:1783966924.665462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587901440 00000100:00100000:2.0:1783966924.665473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783966924.665479:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587901696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587901696:12345-0@lo:400:kworker.0 Request processed in 30us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665521:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783966924.665533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783966924.665538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587901440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587901440:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783966924.665589:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902080 00000100:00100000:2.0:1783966924.665592:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902080 00000100:00100000:2.0:1783966924.665616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902592 00000100:00100000:2.0:1783966924.665619:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902592 00000100:00100000:2.0:1783966924.665630:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902464 00000100:00100000:2.0:1783966924.665632:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902464 00000100:00100000:2.0:1783966924.665643:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783966924.665648:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587902080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665675:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587902080:12345-0@lo:400:kworker.0 Request processed in 26us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665681:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783966924.665691:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783966924.665695:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587902592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665716:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587902592:12345-0@lo:400:kworker.0 Request processed in 21us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783966924.665729:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783966924.665734:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587902464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665787:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587902464:12345-0@lo:400:kworker.0 Request processed in 34us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.665802:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1783966924.665821:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783966924.665825:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966924.665827:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966924.665829:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966924.665860:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587901440:0@lo:400:kworker.0 00010000:00080000:2.0:1783966924.665874:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c7d69c00 x1870624587901952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966924.665884:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587901952:0@lo:400:kworker.0 00010000:00080000:2.0:1783966924.665894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c7d6aa00 x1870624587902464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966924.665902:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587902464:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665912:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587901568:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665920:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587902080:0@lo:400:kworker.0 00010000:00080000:2.0:1783966924.665929:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c7d68e00 x1870624587902592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966924.665936:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587902592:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665971:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587901312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.665981:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587901824:0@lo:400:kworker.0 00010000:00080000:2.0:1783966924.665991:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c7d69500 x1870624587902336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966924.665998:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587902336:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.666015:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587901184:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.666026:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587901696:0@lo:400:kworker.0 00000100:00100000:2.0:1783966924.666036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587902208:0@lo:400:kworker.0 00000100:00100000:0.0:1783966924.666830:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966924.666843:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587902848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966924.666886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966924.666920:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902720 00000100:00100000:0.0:1783966924.666926:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902720 00000100:00100000:0.0:1783966924.666955:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902848 00000100:00100000:0.0:1783966924.666958:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902848 00000100:00100000:0.0:1783966924.666971:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783966924.666978:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587902720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966924.666997:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966924.667034:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587902720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966924.667041:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783966924.667054:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783966924.667060:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587902848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966924.667076:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966924.667114:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587902848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966924.667120:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1783966924.667150:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05d8acad80 x1870624587902848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966924.667166:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587902848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966924.667183:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587902720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966924.668940:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587902976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966924.669003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966924.669054:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587902976 00000100:00100000:2.0:1783966924.669060:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587902976 00000100:00100000:2.0:1783966924.669171:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1783966924.669181:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587902976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966924.669203:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966924.669247:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587902976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966924.669254:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1783966924.669288:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05d8acad80 x1870624587902976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966924.669305:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587902976:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1783966924.860573:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966925.175126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966925.175152:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587903104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966925.175225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966925.175340:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903104 00000100:00100000:3.0:1783966925.175349:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903104 00000100:00100000:3.0:1783966925.175400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783966925.175409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587903104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966925.175444:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966925.175562:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587903104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966925.175569:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783966925.175702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587903104:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966925.879188:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783966926.771411:0:14063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:22:04 (1783966924) 00010000:00010000:0.0:1783966926.903726:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966927.927210:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966928.174745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966928.174902:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563691904 00000100:00100000:2.0:1783966928.174912:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563691904 00000100:00100000:2.0:1783966928.175021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:2.0:1783966928.175034:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:11078:x1870624563691904:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966928.175052:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966928.175076:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160670e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6bfa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783966928.175085:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783966928.175171:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.175183:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.175196:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966928.175257:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966928.175260:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966928.175297:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.175319:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160670e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bfa expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.175337:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bfa expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.175344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc7000) 00010000:00010000:2.0:1783966928.175347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966928.175350:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783966928.175411:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:11078:x1870624563691904:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 381us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966928.175420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1783966928.184186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966928.185038:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692032 00000100:00100000:2.0:1783966928.185049:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692032 00000100:00100000:2.0:1783966928.185131:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1783966928.185142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:11079:x1870624563692032:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966928.185164:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966928.185185:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160670f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c01 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185345:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185361:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185373:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185388:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185396:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185403:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185465:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185474:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185482:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966928.185531:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966928.185535:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966928.185554:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185565:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185573:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185580:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185600:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966928.185604:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185612:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185625:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc7000) 00010000:00010000:2.0:1783966928.185628:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966928.185633:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185638:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160670fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185652:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185667:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185673:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185677:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966928.185680:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185686:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185693:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a04c1cc7200) 00010000:00010000:2.0:1783966928.185696:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966928.185699:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185704:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067102 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185735:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160670f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c01 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185748:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c01 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966928.185755:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c1cc7a00) 00010000:00010000:2.0:1783966928.185757:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966928.185765:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631400, rc 0) 00000100:00100000:2.0:1783966928.185943:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11079:x1870624563692032:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 801us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966928.185951:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1783966928.200585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966928.200654:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692160 00000100:00100000:2.0:1783966928.200665:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692160 00000100:00100000:2.0:1783966928.200738:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783966928.200749:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11079:x1870624563692160:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783966928.200866:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11079:x1870624563692160:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966928.200874:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1783966928.204170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966928.204326:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692416 00000100:00100000:0.0:1783966928.204337:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692416 00000100:00100000:0.0:1783966928.204403:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1783966928.204413:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11079:x1870624563692416:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966928.204433:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966928.204456:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067110 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c08 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204541:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204555:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204567:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204646:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204662:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204818:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1400/0x9269c8b316067125 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204828:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1400/0x9269c8b316067125 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204852:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1400/0x9269c8b316067125 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966928.204863:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783966928.204954:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204961:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204968:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204975:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966928.204979:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204986:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.204999:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c1cc7a00) 00010000:00010000:0.0:1783966928.205002:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966928.205007:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205027:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067117 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205040:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205045:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205057:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205061:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966928.205064:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205069:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a04c3347000) 00010000:00010000:0.0:1783966928.205079:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966928.205082:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205087:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b31606711e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205548:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067110 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c08 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205565:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1400/0x9269c8b316067125 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c08 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966928.205572:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:0.0:1783966928.205575:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966928.205577:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1400, rc 0) 00000100:00100000:0.0:1783966928.205663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11079:x1870624563692416:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1251us (1500us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783966928.205823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1783966928.211088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966928.211173:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692544 00000100:00100000:0.0:1783966928.211184:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692544 00000100:00100000:0.0:1783966928.211257:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1783966928.211267:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11079:x1870624563692544:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783966928.211376:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11079:x1870624563692544:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966928.211384:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1783966928.216455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966928.216560:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692672 00000100:00100000:2.0:1783966928.216570:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692672 00000100:00100000:2.0:1783966928.216660:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1783966928.216672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:11079:x1870624563692672:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1783966928.216954:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1783966928.217894:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1179us 00000100:00100000:2.0:1783966928.248169:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966928.248198:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587903232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966928.248285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966928.248882:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903232 00000100:00100000:1.0:1783966928.248893:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903232 00000100:00100000:1.0:1783966928.248962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783966928.248973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587903232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966928.249010:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966928.249076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587903232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966928.249083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783966928.249132:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587903232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966928.255423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:11079:x1870624563692672:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 38744us (38967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966928.255437:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00010000:00010000:3.0:1783966928.951583:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966929.015459:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783966929.020168:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783966929.157808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966929.157857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966929.157901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966929.157924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966929.157953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966929.157988:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693056 00000100:00100000:1.0:1783966929.158011:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693056 00000100:00100000:1.0:1783966929.158075:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693312 00000100:00100000:1.0:1783966929.158078:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693312 00000100:00100000:1.0:1783966929.158100:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692928 00000100:00100000:1.0:1783966929.158102:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692928 00000100:00100000:1.0:1783966929.158112:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693184 00000100:00100000:1.0:1783966929.158114:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693184 00000100:00100000:1.0:1783966929.158133:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00100000:1.0:1783966929.158144:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563693056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966929.159024:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563692800 00000100:00100000:0.0:1783966929.159035:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563692800 00000100:00100000:0.0:1783966929.159091:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 382 00000100:00100000:0.0:1783966929.159100:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563692800:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966929.159154:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563692800:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 55us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966929.159163:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 382 00000100:00100000:1.0:1783966929.159280:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563693056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1136us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966929.159290:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 291 00000100:00100000:1.0:1783966929.159323:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:1.0:1783966929.159331:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563693312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966929.159378:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563693312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 49us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966929.159386:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 292 00000100:00100000:1.0:1783966929.159398:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:1.0:1783966929.159405:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2402:x1870624563692928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:3.0:1783966929.159573:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966929.159580:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966929.159601:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:3.0:1783966929.159612:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563693184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966929.159649:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563693184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.159657:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 294 00000100:00100000:1.0:1783966929.160577:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2402:x1870624563692928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1165us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966929.160588:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 293 00000100:00100000:1.0:1783966929.783090:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587903488:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783193:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587903360:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783288:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783353:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587903872:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783384:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783406:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587904384:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783431:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783449:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587904896:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783481:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783500:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783966929.783505:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587903744:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783506:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587904000:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783549:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587904256:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783581:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587904512:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783586:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587904768:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783617:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783966929.783621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783623:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587903616:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783661:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587904128:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783680:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903360 00000100:00100000:1.0:1783966929.783681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966929.783689:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903360 00000100:00100000:1.0:1783966929.783696:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587904640:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966929.783734:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903488 00000100:00100000:1.0:1783966929.783738:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903488 00000100:00100000:3.0:1783966929.783746:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1783966929.783754:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587903360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.783761:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903744 00000100:00100000:3.0:1783966929.783847:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ea202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587903360:12345-0@lo:400:kworker.0 Request processed in 92us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.783855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1783966929.783894:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903872 00000100:00100000:3.0:1783966929.783898:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903872 00000100:00100000:3.0:1783966929.783916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587903616 00000100:00100000:3.0:1783966929.783919:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903616 00000100:00100000:3.0:1783966929.783930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783966929.783936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587903872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.783971:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587903872:12345-0@lo:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.783976:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783966929.784002:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783966929.784007:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587903616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587903616:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784046:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1783966929.784065:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904384 00000100:00100000:3.0:1783966929.784069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904384 00000100:00100000:3.0:1783966929.784099:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904896 00000100:00100000:3.0:1783966929.784102:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904896 00000100:00100000:3.0:1783966929.784113:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904256 00000100:00100000:3.0:1783966929.784115:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904256 00000100:00100000:3.0:1783966929.784137:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904768 00000100:00100000:3.0:1783966929.784140:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904768 00000100:00100000:3.0:1783966929.784155:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783966929.784161:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587904384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784193:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587904384:12345-0@lo:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784199:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783966929.784210:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783966929.784215:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587904896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784238:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587904896:12345-0@lo:400:kworker.0 Request processed in 23us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784244:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783966929.784253:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783966929.784259:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587904256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784284:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587904256:12345-0@lo:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784289:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783966929.784298:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783966929.784304:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587904768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784327:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587904768:12345-0@lo:400:kworker.0 Request processed in 24us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784333:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783966929.784356:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904000 00000100:00100000:3.0:1783966929.784358:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904000 00000100:00100000:3.0:1783966929.784376:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904512 00000100:00100000:3.0:1783966929.784379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904512 00000100:00100000:3.0:1783966929.784389:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904128 00000100:00100000:3.0:1783966929.784399:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904128 00000100:00100000:3.0:1783966929.784415:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587904640 00000100:00100000:3.0:1783966929.784417:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587904640 00000100:00100000:3.0:1783966929.784429:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783966929.784434:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587903488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587903488:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1783966929.784483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783966929.784489:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587904000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784516:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587904000:12345-0@lo:400:kworker.0 Request processed in 26us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784521:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783966929.784532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1783966929.784538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587904512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784563:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587904512:12345-0@lo:400:kworker.0 Request processed in 26us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1783966929.784580:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783966929.784586:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587904128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784611:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587904128:12345-0@lo:400:kworker.0 Request processed in 25us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784617:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783966929.784627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1783966929.784632:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587904640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784657:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587904640:12345-0@lo:400:kworker.0 Request processed in 25us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966929.784669:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1783966929.784710:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966929.784715:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966929.784718:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966929.784721:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966929.784759:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587904256:0@lo:400:kworker.0 00010000:00080000:3.0:1783966929.784806:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7dfc000 x1870624587904768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966929.784817:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587904768:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784829:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587903360:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784839:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587903872:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587904384:0@lo:400:kworker.0 00010000:00080000:3.0:1783966929.784860:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7dfc380 x1870624587904896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966929.784869:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587904896:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.784971:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587903616:0@lo:400:kworker.0 00010000:00080000:3.0:1783966929.784993:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c3720700 x1870624587904128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966929.785004:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587904128:0@lo:400:kworker.0 00010000:00080000:3.0:1783966929.785016:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c3722d80 x1870624587904640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966929.785025:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587904640:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.785046:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587904000:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.785058:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587904512:0@lo:400:kworker.0 00000100:00100000:3.0:1783966929.785067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587903488:0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.785198:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587903744 00000100:00100000:1.0:1783966929.785242:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1783966929.785250:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587903744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966929.785300:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587903744:12345-0@lo:400:kworker.0 Request processed in 51us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966929.785307:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1783966929.785337:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587903744:0@lo:400:kworker.0 00000100:00100000:0.0:1783966929.785766:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587905280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966929.785784:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587905024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966929.785824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966929.785857:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966929.785863:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587905408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966929.785898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966929.785928:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587905280 00000100:00100000:0.0:1783966929.785934:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587905280 00000100:00100000:0.0:1783966929.785964:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587905408 00000100:00100000:0.0:1783966929.785967:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587905408 00000100:00100000:0.0:1783966929.785992:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783966929.786000:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587905280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966929.786027:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966929.786067:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587905280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966929.786085:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783966929.786100:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783966929.786106:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587905408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966929.786123:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966929.786152:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587905408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966929.786159:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783966929.786200:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587905408:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783966929.786211:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05d8ac9180 x1870624587905280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966929.786223:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587905280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966929.786255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966929.786281:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587905024 00000100:00100000:0.0:1783966929.786284:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587905024 00000100:00100000:0.0:1783966929.786304:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783966929.786310:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587905024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966929.786326:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966929.786358:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587905024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966929.786363:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1783966929.786386:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05d8ac8380 x1870624587905024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783966945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966929.786398:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587905024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783966929.786640:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587905152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966929.786676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966929.786844:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587905152 00000100:00100000:0.0:1783966929.786849:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587905152 00000100:00100000:0.0:1783966929.786875:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783966929.786882:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587905152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966929.786892:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966929.786926:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587905152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966929.786932:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783966929.786961:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587905152:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783966929.975131:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966930.296246:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966930.296413:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587905536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966930.296649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966930.296713:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587905536 00000100:00100000:3.0:1783966930.296721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587905536 00000100:00100000:3.0:1783966930.296768:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783966930.296800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587905536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966930.296838:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783966930.297894:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587905536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1089us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966930.297907:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783966930.298014:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587905536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783966930.502319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966930.502402:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693440 00000100:00100000:0.0:1783966930.502412:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693440 00000100:00100000:0.0:1783966930.502481:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1783966930.502491:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11121:x1870624563693440:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966930.502510:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966930.502530:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c0f expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502612:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502625:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502648:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502662:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502669:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502675:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502718:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502724:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502730:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502735:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966930.502740:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502757:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502788:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc7000) 00010000:00010000:0.0:1783966930.502791:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966930.502796:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502803:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606713a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502816:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502822:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502828:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502833:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966930.502836:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.502841:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783966930.503109:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783966930.503133:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966930.503137:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966930.503141:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.503157:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067141 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.503193:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067133 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c0f expref: 10 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.503204:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc7000) 00010000:00010000:0.0:1783966930.503206:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966930.503210:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c0f expref: 10 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.503219:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1e00, rc 0) 00000100:00100000:0.0:1783966930.503313:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11121:x1870624563693440:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 823us (1003us total) trans 0 rc 301/301 00000100:00100000:0.0:1783966930.503320:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1783966930.512083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.512186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693696 00000100:00100000:3.0:1783966930.512196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693696 00000100:00100000:3.0:1783966930.512268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1783966930.512280:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11121:x1870624563693696:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:3.0:1783966930.512338:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966930.512367:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160670ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bfa expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512401:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1cc7000) 00010000:00010000:3.0:1783966930.512413:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966930.512479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512493:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512502:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512515:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512522:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.512528:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513438:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513447:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966930.513463:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005297a102 reply state 000000006d71c27d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513492:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513499:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:3.0:1783966930.513501:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966930.513504:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783966930.513510:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783966930.513519:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513525:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513531:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513537:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966930.513541:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513548:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513557:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3422e00) 00010000:00010000:3.0:1783966930.513560:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966930.513563:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513569:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067148 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966930.513596:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005297a102 reply state 000000006d71c27d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513605:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.513610:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a04c3422100) 00010000:00010000:3.0:1783966930.513612:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966930.513614:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783966930.513792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:11121:x1870624563693696:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 1492us (1697us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783966930.513801:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1783966930.625232:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966930.626118:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693824 00000100:00100000:0.0:1783966930.626130:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693824 00000100:00100000:0.0:1783966930.626199:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1783966930.626210:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:11129:x1870624563693824:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:0.0:1783966930.626237:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966930.626262:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b31606715d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626332:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626365:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626378:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966930.626427:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783966930.626432:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966930.626469:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626493:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b31606715d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c16 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626512:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c16 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.626527:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966930.626530:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783966930.626534:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:0.0:1783966930.626607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:11129:x1870624563693824:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 399us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966930.626615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1783966930.678253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.678419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563693952 00000100:00100000:3.0:1783966930.678429:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563693952 00000100:00100000:3.0:1783966930.678492:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1783966930.678502:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:11135:x1870624563693952:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966930.678521:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966930.678542:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606716b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c1d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679285:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679300:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679311:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679338:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679347:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679354:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679435:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679444:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679452:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966930.679488:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783966930.679492:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966930.679529:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679541:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679547:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679553:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679569:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966930.679574:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679582:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679596:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966930.679599:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966930.679605:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679611:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679640:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679647:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679652:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679658:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966930.679660:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679666:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679685:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a04c3422100) 00010000:00010000:3.0:1783966930.679688:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966930.679690:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.679696:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316067179 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.680189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606716b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c1d expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.680211:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c1d expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.680218:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:3.0:1783966930.680220:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783966930.680223:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63c00, rc 0) 00000100:00100000:3.0:1783966930.680299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:11135:x1870624563693952:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1797us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966930.680309:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1783966930.685083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.685170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694208 00000100:00100000:3.0:1783966930.685180:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694208 00000100:00100000:3.0:1783966930.685247:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1783966930.685258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:11135:x1870624563694208:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966930.685279:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966930.685302:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067187 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c24 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685443:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685454:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685526:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685535:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.685542:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783966930.686232:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1783966930.686382:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686395:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686403:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686441:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686463:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686470:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686477:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966930.686482:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686490:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686504:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:3.0:1783966930.686507:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966930.686512:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686519:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606718e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966930.686534:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000069db49f reply state 0000000037d1bc15 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686553:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:3.0:1783966930.686555:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966930.686558:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783966930.686590:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067187 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686612:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.686620:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:3.0:1783966930.686622:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966930.686625:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179400, rc 0) 00000100:00100000:2.0:1783966930.688347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:11135:x1870624563694208:12345-192.168.204.59@tcp:101:bash.0 Request processed in 3082us (3495us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783966930.688359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1783966930.692700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.692950:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694336 00000100:00100000:3.0:1783966930.692960:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694336 00000100:00100000:3.0:1783966930.693032:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783966930.693041:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563694336:12345-192.168.204.59@tcp:8:bash.0 00010000:00080000:3.0:1783966930.693080:0:8434:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:3.0:1783966930.693137:0:8434:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b3160671aa 00002000:00100000:3.0:1783966930.693150:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4272c10e-7366-407e-b067-e3d2ea5c5b05/ffff9a05f571b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783966930.693161:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1783966930.693242:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783966930.693272:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9a05f571e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966930.693332:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563694336:12345-192.168.204.59@tcp:8:bash.0 Request processed in 291us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966930.693341:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783966930.700324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966930.700543:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694464 00000100:00100000:0.0:1783966930.700552:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694464 00000100:00100000:0.0:1783966930.700622:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1783966930.700638:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:0:x1870624563694464:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966930.700669:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966930.700690:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c2b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783966930.700802:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1783966930.701160:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783966930.701266:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1783966930.701272:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966930.701291:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966930.701313:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966930.701325:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:2.0:1783966930.701386:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:0:x1870624563694464:12345-192.168.204.59@tcp:101:bash.0 Request processed in 755us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966930.701392:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1783966930.708600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.709057:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694592 00000100:00100000:3.0:1783966930.709068:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694592 00000100:00100000:3.0:1783966930.709132:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1783966930.709143:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11135:x1870624563694592:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966930.709179:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966930.709201:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c32 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.709244:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.709253:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966930.709257:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966930.709262:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.709294:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.709306:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966930.709320:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1870624587905664:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966930.709425:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966930.716634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.716746:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1870624587905664:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966930.716817:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.716839:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179800, rc 0) 00000100:00100000:3.0:1783966930.716923:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:11135:x1870624563694592:12345-192.168.204.59@tcp:101:bash.0 Request processed in 7780us (8331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966930.716933:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1783966930.717470:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694720 00000100:00100000:0.0:1783966930.717478:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694720 00010000:00010000:0.0:1783966930.717509:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966930.717537:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783966930.717545:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563694720:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966930.717558:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966930.717581:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.717595:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.717619:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b3160671b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c2b expref: 8 pid: 8432 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.717644:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966930.717648:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966930.717657:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.717675:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966930.717709:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966930.717722:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1870624587905792:192.168.204.59@tcp:105: 00000100:00100000:0.0:1783966930.717876:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783966930.729529:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966930.729930:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563694976 00000100:00100000:2.0:1783966930.729939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563694976 00000100:00100000:2.0:1783966930.730011:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1783966930.730021:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:11135:x1870624563694976:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1783966930.730347:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11135:x1870624563694976:12345-192.168.204.59@tcp:35:bash.0 Request processed in 326us (827us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783966930.730356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1783966930.735840:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1870624587905792:192.168.204.59@tcp:105: 00010000:00010000:0.0:1783966930.735870:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966930.735947:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563694720:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 18401us (19329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966930.735960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783966930.849157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966930.851841:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563695232 00000100:00100000:3.0:1783966930.852110:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563695232 00000100:00100000:3.0:1783966930.852203:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1783966930.852214:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11145:x1870624563695232:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966930.852247:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966930.852268:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160671bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c39 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966930.852376:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783966930.852481:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160671bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c39 expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.852495:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966930.852498:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966930.852503:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160671bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c39 expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966930.852520:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178400, rc 0) 00000100:00100000:3.0:1783966930.852593:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:11145:x1870624563695232:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 380us (3444us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1783966930.852601:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:2.0:1783966930.858418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966930.858541:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563695488 00000100:00100000:0.0:1783966930.858551:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563695488 00000100:00100000:0.0:1783966930.858614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1783966930.859979:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:11145:x1870624563695488:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783966930.860261:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:11145:x1870624563695488:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1638us (1853us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783966930.860270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:0.0:1783966930.999490:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966931.022679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966931.022764:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563695616 00000100:00100000:3.0:1783966931.022798:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563695616 00000100:00100000:3.0:1783966931.022862:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1783966931.022873:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:11151:x1870624563695616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966931.022912:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966931.022941:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160671cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c40 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023040:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023054:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023066:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966931.023118:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783966931.023122:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966931.023144:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023172:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160671cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c40 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023194:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c40 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.023203:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:3.0:1783966931.023206:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783966931.023210:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178a00, rc 0) 00000100:00100000:3.0:1783966931.023277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11151:x1870624563695616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 406us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966931.023285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1783966931.028517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.028688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563695872 00000100:00100000:2.0:1783966931.028700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563695872 00000100:00100000:2.0:1783966931.028767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:2.0:1783966931.028815:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11151:x1870624563695872:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966931.028848:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966931.028871:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160671db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c47 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.029026:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160671e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.029042:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160671e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.029055:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160671e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966931.029067:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783966931.029405:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160671db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c47 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.029427:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160671e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c47 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.029436:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:2.0:1783966931.029440:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966931.029444:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630600, rc 0) 00000100:00100000:2.0:1783966931.029517:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:11151:x1870624563695872:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 706us (1010us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783966931.029524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:2.0:1783966931.037120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966931.038608:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696128 00000100:00100000:0.0:1783966931.038621:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696128 00000100:00100000:0.0:1783966931.038786:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:0.0:1783966931.038813:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:11151:x1870624563696128:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966931.038854:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966931.038876:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160671f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c4e expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.039078:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.039094:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.039106:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966931.039119:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783966931.039227:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160671f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c4e expref: 24 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.039246:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c4e expref: 23 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.039255:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:0.0:1783966931.039258:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783966931.039263:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0600, rc 0) 00000100:00100000:0.0:1783966931.039337:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:11151:x1870624563696128:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 527us (2225us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783966931.039344:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1783966931.047534:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.047702:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696256 00000100:00100000:1.0:1783966931.047712:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696256 00000100:00100000:1.0:1783966931.047807:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783966931.047819:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:2403:x1870624563696256:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966931.047848:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966931.047877:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160671e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c47 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.047896:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:1.0:1783966931.047902:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966931.047976:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2403:x1870624563696256:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 158us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.048195:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783966931.056495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966931.056595:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696384 00000100:00100000:3.0:1783966931.056604:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696384 00000100:00100000:3.0:1783966931.056667:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783966931.056677:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563696384:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:3.0:1783966931.056718:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.056739:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.056747:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783966931.056751:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966931.056756:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.056814:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.057104:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 7 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966931.057120:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587905920:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966931.057204:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966931.059638:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587905920:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966931.059668:0:8714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966931.069414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966931.070039:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696512 00000100:00100000:3.0:1783966931.070050:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696512 00002000:00100000:3.0:1783966931.070095:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9a04c3fcd180 x1870624563696512/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:92/0 lens 504/0 e 0 to 0 dl 1783966942 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966931.070139:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3fcd180 with x1870624563696512 ext(0->12) 00010000:00010000:3.0:1783966931.070149:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 8 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.070167:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 8 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783966931.070176:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3fcd180 00000100:00100000:3.0:1783966931.070210:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1783966931.070219:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563696512:12345-192.168.204.59@tcp:4:lfs.0 00000001:00100000:2.0:1783966931.071998:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000100:00100000:3.0:1783966931.072806:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563696512:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 2553us (3441us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783966931.072818:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:3.0:1783966931.072830:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9a04c3fcd180 x1870624563696512/t4294967300(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:92/0 lens 504/448 e 0 to 0 dl 1783966942 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966931.072840:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3fcd180 with x1870624563696512 ext(0->12) 00010000:00010000:3.0:1783966931.072850:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.072867:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783966931.072875:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3fcd180 00000100:00100000:3.0:1783966931.080991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.081312:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696640 00000100:00100000:2.0:1783966931.081322:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696640 00010000:00010000:2.0:1783966931.081370:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966931.081415:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1783966931.081426:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563696640:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966931.081441:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783966931.081460:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783966931.081463:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783966930 00002000:00010000:2.0:1783966931.081465:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783966930 00002000:00010000:2.0:1783966931.081467:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783966930 00002000:00010000:2.0:1783966931.081469:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783966931.081476:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.081490:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.081514:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b3160671b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c32 expref: 9 pid: 8434 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.081536:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966931.081540:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966931.081546:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.081555:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.081605:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966931.081877:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563696640:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 452us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966931.081886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00010000:00010000:1.0:1783966931.082071:0:8714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082082:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082104:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082113:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082193:0:8714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082201:0:8714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966931.082205:0:8714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082226:0:8714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082240:0:8714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.082247:0:8714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7e79755/0x9269c8b316067205 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966931.082303:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563696384:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 25627us (25817us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.082311:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1783966931.086525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966931.086611:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563696896 00000100:00100000:0.0:1783966931.086720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563696896 00000100:00100000:0.0:1783966931.086837:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1783966931.086899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11151:x1870624563696896:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:0.0:1783966931.086973:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c4e expref: 22 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966931.087315:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1783966931.087354:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783966931.087616:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1783966931.087765:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.087804:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.087814:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.088016:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.088031:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 26 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966931.088046:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587906048:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966931.088243:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3768e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966931.092682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.092813:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587906048:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966931.092840:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966931.093512:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563697024 00000100:00100000:1.0:1783966931.093521:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563697024 00010000:00010000:1.0:1783966931.093559:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966931.093598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783966931.093607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:2401:x1870624563697024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966931.093931:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966931.093940:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.093953:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.094004:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b31606719c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c24 expref: 27 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.094021:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:1.0:1783966931.094026:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.094035:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.095969:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.096022:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966931.096106:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:2401:x1870624563697024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2495us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.096117:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00010000:00010000:2.0:1783966931.096496:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.096505:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783966931.096645:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1783966931.096797:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1783966931.096901:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587906176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783966931.096974:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966931.097018:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3366840 going to sleep for 11 seconds 00000100:00100000:0.0:1783966931.097170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587906176 00000100:00100000:0.0:1783966931.097178:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587906176 00000100:00100000:0.0:1783966931.097239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966931.097264:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587906176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783966931.097350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587906176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966931.097356:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783966931.097489:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587906176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783966931.101227:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1783966931.101332:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587906304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783966931.101401:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966931.101431:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c54abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966931.101599:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587906304 00000100:00100000:0.0:1783966931.101608:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587906304 00000100:00100000:0.0:1783966931.101668:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966931.101678:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587906304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783966931.101859:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1870624587906304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 182us (457us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783966931.101867:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783966931.102293:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587906304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783966931.102361:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1783966931.102402:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102414:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102422:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102429:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966931.102433:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102441:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102457:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:2.0:1783966931.102460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783966931.102465:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.102472:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b31606720c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783966931.102576:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783966931.102798:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783966931.102812:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407304041262ns, next at 408304039025ns, rc = 0 00000001:00080000:2.0:1783966931.102820:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1783966931.102845:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a04c3422b00) 00010000:00010000:2.0:1783966931.102848:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783966931.102862:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160671f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c4e expref: 30 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966931.102978:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:11151:x1870624563696896:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 16081us (16461us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1783966931.102987:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000020:00080000:2.0:1783966931.102992:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1783966931.103085:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966931.106957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.107150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563697152 00000100:00100000:1.0:1783966931.107160:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563697152 00000100:00100000:1.0:1783966931.107221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783966931.107231:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:11151:x1870624563697152:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966931.107254:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966931.107278:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067213 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c55 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.107336:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067213 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c55 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.107371:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067213 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c55 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.107393:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966931.107396:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966931.107400:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f800, rc 0) 00000100:00100000:1.0:1783966931.107466:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11151:x1870624563697152:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 236us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.107473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:0.0:1783966931.110909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.111059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563697408 00000100:00100000:1.0:1783966931.111071:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563697408 00000100:00100000:1.0:1783966931.111130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783966931.111139:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11151:x1870624563697408:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966931.111393:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+31:11151:x1870624563697408:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 254us (493us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1783966931.111402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1783966931.204501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966931.204567:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563697664 00000100:00100000:3.0:1783966931.204578:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563697664 00000100:00100000:3.0:1783966931.204805:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1783966931.204817:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+31:11161:x1870624563697664:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966931.204839:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966931.204868:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606721a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c5c expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966931.204984:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1783966931.205085:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606721a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c5c expref: 33 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.205100:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966931.205103:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966931.205108:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606721a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c5c expref: 33 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.205124:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179800, rc 0) 00000100:00100000:3.0:1783966931.205188:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11161:x1870624563697664:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 372us (697us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1783966931.205195:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:0.0:1783966931.211384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.211486:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563697792 00000100:00100000:1.0:1783966931.211496:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563697792 00000100:00100000:1.0:1783966931.211591:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1783966931.211603:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11161:x1870624563697792:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1783966931.211694:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211713:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211742:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211755:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211763:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211816:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211905:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211914:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211921:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966931.211982:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.211996:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212003:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212010:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212028:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966931.212032:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212040:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212053:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966931.212056:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966931.212060:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212067:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067228 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212080:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212087:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212093:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212098:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966931.212101:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212107:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212128:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:1.0:1783966931.212130:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966931.212133:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212138:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606722f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212148:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212154:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212160:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212165:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966931.212168:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212174:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212181:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966931.212183:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966931.212186:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.212192:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067236 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966931.212286:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11161:x1870624563697792:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 684us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.212294:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1783966931.220250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.220421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563698048 00000100:00100000:2.0:1783966931.220432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563698048 00000100:00100000:2.0:1783966931.220547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1783966931.220559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11161:x1870624563698048:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783966931.220820:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:11161:x1870624563698048:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 262us (580us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1783966931.220828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:2.0:1783966931.289257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.289381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563698304 00000100:00100000:1.0:1783966931.289393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563698304 00000100:00100000:1.0:1783966931.289461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1783966931.289471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:11164:x1870624563698304:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966931.289498:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966931.289524:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606723d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289615:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289645:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289658:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289669:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289676:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289682:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289858:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289866:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289873:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966931.289884:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783966931.289973:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289980:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289987:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.289992:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966931.289997:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290003:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290015:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966931.290017:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966931.290022:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290039:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067244 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290051:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290057:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290062:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290067:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966931.290070:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290077:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290085:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:1.0:1783966931.290087:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966931.290090:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290096:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606724b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290137:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606723d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290150:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.290164:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966931.290166:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966931.290169:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e000, rc 0) 00000100:00100000:1.0:1783966931.290230:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11164:x1870624563698304:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 760us (986us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1783966931.290237:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1783966931.297530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966931.300230:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563698432 00000100:00100000:3.0:1783966931.300258:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563698432 00000100:00100000:3.0:1783966931.300327:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1783966931.300338:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11164:x1870624563698432:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:3.0:1783966931.300410:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300445:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300457:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300494:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300502:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300508:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300514:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966931.300518:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300526:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300551:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:3.0:1783966931.300554:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966931.300560:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.300566:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067260 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966931.300660:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11164:x1870624563698432:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 323us (3145us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966931.300674:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1783966931.307273:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966931.307796:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563698688 00000100:00100000:0.0:1783966931.307807:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563698688 00000100:00100000:0.0:1783966931.307880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783966931.307892:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11164:x1870624563698688:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783966931.308441:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:11164:x1870624563698688:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 549us (1175us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783966931.308451:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1783966931.544110:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.544269:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563698944 00000100:00100000:1.0:1783966931.544283:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563698944 00000100:00100000:1.0:1783966931.544385:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1783966931.544399:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:11195:x1870624563698944:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1783966931.545096:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966931.545132:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067267 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c6a expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.545290:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606726e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.545310:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606726e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.545341:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606726e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966931.545357:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783966931.545822:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067267 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c6a expref: 39 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.545872:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606726e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c6a expref: 38 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.545883:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966931.545887:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966931.545891:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966931.546009:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11195:x1870624563698944:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1612us (1915us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783966931.546019:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1783966931.552918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.553110:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563699200 00000100:00100000:2.0:1783966931.553124:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563699200 00000100:00100000:2.0:1783966931.553206:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1783966931.553219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11195:x1870624563699200:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:2.0:1783966931.553584:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:11195:x1870624563699200:12345-192.168.204.59@tcp:35:cat.0 Request processed in 366us (680us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1783966931.553593:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1783966931.558018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.558424:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563699328 00000100:00100000:2.0:1783966931.558439:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563699328 00000100:00100000:2.0:1783966931.558543:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783966931.558583:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:2402:x1870624563699328:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966931.558605:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966931.558652:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606726e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c6a expref: 39 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.558679:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966931.558684:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966931.559067:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:2402:x1870624563699328:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 485us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966931.559076:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1783966931.653372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966931.653531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563699584 00000100:00100000:0.0:1783966931.653544:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563699584 00000100:00100000:0.0:1783966931.653629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1783966931.653643:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11201:x1870624563699584:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:0.0:1783966931.653700:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966931.653705:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783966931.653744:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160671d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c40 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.653831:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966931.653839:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966931.653859:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606727c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c71 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.654116:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.654135:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.654145:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.654200:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966931.654216:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 38 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966931.654233:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587906432:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966931.654539:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3768e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966931.657517:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587906432:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966931.657565:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966931.664915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.665266:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563699712 00000100:00100000:2.0:1783966931.665350:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563699712 00010000:00010000:2.0:1783966931.665484:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 39 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966931.665595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:2.0:1783966931.665608:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:2403:x1870624563699712:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966931.665639:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966931.665649:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 39 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665665:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 39 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665693:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067252 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c63 expref: 39 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665737:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966931.665743:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665754:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665762:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.665875:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966931.665968:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:2403:x1870624563699712:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 362us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966931.665978:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00010000:00010000:3.0:1783966931.666400:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.666410:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966931.666434:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783966931.666642:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606727c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.666663:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966931.666672:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:3.0:1783966931.666675:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783966931.666678:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0200, rc 0) 00000100:00100000:3.0:1783966931.666721:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11201:x1870624563699584:12345-192.168.204.59@tcp:101:dd.0 Request processed in 13082us (13365us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1783966931.666730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1783966931.675928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966931.676560:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563699840 00000100:00100000:1.0:1783966931.676575:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563699840 00000100:00100000:1.0:1783966931.676674:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:1.0:1783966931.676687:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11201:x1870624563699840:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783966931.676723:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966931.676754:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067291 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.676832:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.676854:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.676868:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.677131:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067291 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.677156:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966931.677166:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966931.677169:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966931.677173:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ec00, rc 0) 00000100:00100000:1.0:1783966931.677261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:11201:x1870624563699840:12345-192.168.204.59@tcp:101:dd.0 Request processed in 576us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966931.677280:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1783966931.684425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966931.690923:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700096 00000100:00100000:2.0:1783966931.690955:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700096 00000100:00100000:2.0:1783966931.691519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1783966931.691535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:11201:x1870624563700096:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:2.0:1783966931.691915:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.691937:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.691960:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783966931.692016:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1783966931.692123:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7a9d6d3 reply state 00000000ea19dc3e transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.692159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966931.692168:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966931.692171:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966931.692176:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966931.692331:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:11201:x1870624563700096:12345-192.168.204.59@tcp:36:dd.0 Request processed in 797us (7979us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1783966931.692340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000020:00080000:2.0:1783966931.692348:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783966932.017714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.018029:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700224 00000100:00100000:0.0:1783966932.018043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700224 00000100:00100000:0.0:1783966932.018216:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783966932.018229:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:11215:x1870624563700224:12345-192.168.204.59@tcp:101:stat.0 00000100:00080000:3.0:1783966932.018246:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783966932.018266:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966932.018294:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160672a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c7f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018384:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018402:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018420:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018433:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018440:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018446:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018555:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018568:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018603:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018648:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.018663:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 43 pid: 6519 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966932.018679:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587906560:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966932.018856:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3768e40 going to sleep for 11 seconds 00010000:00010000:2.0:1783966932.023083:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966932.026056:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.026123:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700480 00000100:00100000:2.0:1783966932.026136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700480 00000100:00100000:2.0:1783966932.026203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1783966932.026214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:6639:x1870624563700480:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783966932.026326:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587906560:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966932.026364:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966932.026914:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:6639:x1870624563700480:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 699us (870us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783966932.026925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783966932.031646:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.032054:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700608 00000100:00100000:1.0:1783966932.034911:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700608 00010000:00010000:1.0:1783966932.035017:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 45 pid: 6519 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966932.035103:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1783966932.035116:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:2400:x1870624563700608:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966932.035140:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966932.035149:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 45 pid: 6519 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035165:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 45 pid: 6519 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035219:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067283 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c71 expref: 45 pid: 6519 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035241:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.035246:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035257:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035266:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.035307:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966932.035412:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:2400:x1870624563700608:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 298us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966932.035420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00010000:00010000:0.0:1783966932.035472:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.035484:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966932.035959:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783966932.035966:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966932.036032:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036050:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036083:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036091:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036099:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036105:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.036110:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036118:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966932.036134:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966932.036139:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036145:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160672ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036158:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036165:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036171:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036183:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.036186:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036203:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036214:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:0.0:1783966932.036216:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966932.036220:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036226:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036268:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160672a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c7f expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036287:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c7f expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.036295:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966932.036298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966932.036301:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1e00, rc 0) 00000100:00100000:0.0:1783966932.036505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:11215:x1870624563700224:12345-192.168.204.59@tcp:101:stat.0 Request processed in 18277us (18806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966932.036589:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783966932.110048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.110364:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700864 00000100:00100000:1.0:1783966932.110378:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700864 00000100:00100000:1.0:1783966932.110469:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1783966932.110482:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:11221:x1870624563700864:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:1.0:1783966932.110567:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966932.110604:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160672bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c7f expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.110628:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.110634:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966932.110924:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.110957:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.110970:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783966932.111028:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1783966932.111055:0:7847:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003783df5c reply state 00000000f4510b02 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.111082:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.111088:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.111091:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783966932.111094:0:7847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783966932.111399:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:11221:x1870624563700864:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 919us (1363us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783966932.111409:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000020:00080000:1.0:1783966932.111416:0:7847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783966932.297086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.297233:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563700992 00000100:00100000:2.0:1783966932.297247:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563700992 00000100:00100000:2.0:1783966932.297350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1783966932.297363:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:11236:x1870624563700992:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:2.0:1783966932.297399:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966932.297429:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160672c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297518:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297548:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297563:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297575:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297582:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297589:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297697:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297706:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297712:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966932.297763:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1783966932.297810:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966932.297841:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297855:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297874:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297881:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297889:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297896:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966932.297900:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297908:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297923:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966932.297926:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966932.297931:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297950:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160672d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297967:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297973:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297978:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297989:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966932.297992:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.297997:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.298007:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:2.0:1783966932.298009:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966932.298012:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.298018:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.298051:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160672c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.298066:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.298074:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966932.298077:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966932.298079:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:2.0:1783966932.298170:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+46:11236:x1870624563700992:12345-192.168.204.59@tcp:101:stat.0 Request processed in 809us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966932.298179:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1783966932.402962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.403152:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563701248 00000100:00100000:0.0:1783966932.403166:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563701248 00000100:00100000:0.0:1783966932.403250:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1783966932.403262:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+46:11246:x1870624563701248:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966932.403301:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966932.403329:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966932.403469:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783966932.403623:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c8d expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.403640:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966932.403643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966932.403649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160672e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c8d expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.403667:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1000, rc 0) 00000100:00100000:0.0:1783966932.403751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:11246:x1870624563701248:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 490us (819us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1783966932.403759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1783966932.408000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.408251:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563701504 00000100:00100000:2.0:1783966932.408265:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563701504 00000100:00100000:2.0:1783966932.408353:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1783966932.408366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:11246:x1870624563701504:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783966932.408716:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+48:11246:x1870624563701504:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 351us (731us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1783966932.408725:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783966932.465425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.465570:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563701760 00000100:00100000:0.0:1783966932.465585:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563701760 00000100:00100000:2.0:1783966932.465947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1783966932.465963:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+48:11252:x1870624563701760:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966932.465997:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966932.466026:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160672f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c94 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.466172:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.466191:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.466201:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.466243:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.466258:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 49 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966932.466301:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587906688:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966932.466693:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966932.470544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.470705:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563701888 00000100:00100000:0.0:1783966932.470719:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563701888 00010000:00010000:0.0:1783966932.470811:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 50 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966932.470892:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:0.0:1783966932.470905:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:2400:x1870624563701888:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966932.470926:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966932.470944:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 50 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.470960:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 50 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.470991:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966932.470996:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.471010:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.471018:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.471044:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966932.471118:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:2400:x1870624563701888:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 215us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966932.471127:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00010000:00010000:1.0:1783966932.473039:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160672de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c86 expref: 49 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966932.473072:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587906688:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966932.473115:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.473127:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.473157:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.473184:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783966932.473379:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160672f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.473397:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.473407:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.473410:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783966932.473414:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630200, rc 0) 00000100:00100000:1.0:1783966932.473565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:11252:x1870624563701760:12345-192.168.204.59@tcp:101:bash.0 Request processed in 7604us (8154us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783966932.473576:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1783966932.477088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.477196:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563702144 00000100:00100000:1.0:1783966932.477211:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563702144 00000100:00100000:1.0:1783966932.477338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1783966932.477352:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:11252:x1870624563702144:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:1.0:1783966932.481320:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.481354:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.481368:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783966932.481483:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1783966932.481514:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9942d62 reply state 000000000441a682 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.481530:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.481539:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.481542:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783966932.481547:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783966932.481941:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:11252:x1870624563702144:12345-192.168.204.59@tcp:36:bash.0 Request processed in 4576us (4850us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1783966932.481952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000020:00080000:1.0:1783966932.481961:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783966932.486394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966932.486485:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563702272 00000100:00100000:3.0:1783966932.486499:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563702272 00000100:00100000:3.0:1783966932.486568:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1783966932.486579:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:11252:x1870624563702272:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966932.487141:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966932.487172:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606730f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6c9b expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966932.487299:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966932.487322:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966932.487333:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966932.487384:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966932.487402:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 53 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966932.487443:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587906816:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966932.487554:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966932.490523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.491003:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563702400 00000100:00100000:2.0:1783966932.491016:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563702400 00010000:00010000:2.0:1783966932.491075:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 54 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966932.491130:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1783966932.491142:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:2401:x1870624563702400:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966932.491164:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966932.491173:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 54 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.491188:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 54 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.491219:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966932.491226:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.491239:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.491248:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.491297:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966932.491379:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:2401:x1870624563702400:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 238us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966932.491387:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00010000:00010000:1.0:1783966932.492731:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160672fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c94 expref: 53 pid: 6517 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966932.492765:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587906816:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966932.493018:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.493031:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.493036:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.493109:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783966932.493115:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966932.493166:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.493208:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606730f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c9b expref: 53 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.493226:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c9b expref: 52 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.493235:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.493238:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966932.493241:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179800, rc 0) 00000100:00100000:1.0:1783966932.493312:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:11252:x1870624563702272:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6734us (6932us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966932.493322:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1783966932.496136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.496269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563702656 00000100:00100000:0.0:1783966932.496284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563702656 00000100:00100000:0.0:1783966932.496361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783966932.496373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:11252:x1870624563702656:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:0.0:1783966932.496912:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11252:x1870624563702656:12345-192.168.204.59@tcp:35:bash.0 Request processed in 539us (789us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783966932.496921:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783966932.580684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.580871:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563702912 00000100:00100000:1.0:1783966932.580885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563702912 00000100:00100000:1.0:1783966932.580978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:1.0:1783966932.580991:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11262:x1870624563702912:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966932.581025:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966932.581055:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b31606731d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ca2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.581196:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783966932.581330:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b31606731d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ca2 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.581347:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966932.581369:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783966932.581377:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b31606731d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ca2 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.581394:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e000, rc 0) 00000100:00100000:1.0:1783966932.581475:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11262:x1870624563702912:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 486us (808us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1783966932.581483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:3.0:1783966932.585509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.585650:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563703040 00000100:00100000:0.0:1783966932.585665:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563703040 00000100:00100000:0.0:1783966932.585749:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1783966932.585762:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11262:x1870624563703040:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1783966932.585947:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.585972:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.585988:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586002:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586010:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586018:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586122:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586132:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586163:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966932.586238:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586256:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586263:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586269:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586275:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.586279:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586287:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586301:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966932.586304:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966932.586309:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586316:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606732b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586331:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586344:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586350:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586356:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.586360:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586367:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586376:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:0.0:1783966932.586378:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966932.586382:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586388:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586398:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586404:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586410:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586415:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.586427:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586434:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586443:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966932.586446:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966932.586449:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.586455:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067339 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966932.586552:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11262:x1870624563703040:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 791us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966932.586564:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1783966932.590354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.590487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563703296 00000100:00100000:1.0:1783966932.590502:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563703296 00000100:00100000:1.0:1783966932.590734:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1783966932.590747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11262:x1870624563703296:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966932.591146:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:11262:x1870624563703296:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 400us (806us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1783966932.591154:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1783966932.631151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.631265:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563703552 00000100:00100000:1.0:1783966932.631279:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563703552 00000100:00100000:1.0:1783966932.631358:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:1.0:1783966932.631369:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:11265:x1870624563703552:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966932.631400:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966932.631429:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067340 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ca9 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631536:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631554:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631581:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631605:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631614:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.631621:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632054:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632070:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632077:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.632089:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783966932.632196:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632204:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632212:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632219:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966932.632236:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632250:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632266:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966932.632270:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966932.632275:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632283:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067347 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632300:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632307:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632313:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632319:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966932.632322:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632328:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632336:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:1.0:1783966932.632338:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966932.632350:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632357:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606734e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632408:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067340 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ca9 expref: 58 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632522:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ca9 expref: 57 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.632531:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.632534:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966932.632536:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e200, rc 0) 00000100:00100000:1.0:1783966932.633299:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:11265:x1870624563703552:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1927us (2159us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783966932.633311:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1783966932.636917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966932.636983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.637164:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563703680 00000100:00100000:0.0:1783966932.637177:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563703680 00000100:00100000:0.0:1783966932.637255:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:0.0:1783966932.637267:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:11265:x1870624563703680:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1783966932.637362:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637384:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637400:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637446:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637472:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637479:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637486:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966932.637491:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637500:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637516:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966932.637519:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966932.637524:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966932.637531:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067363 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966932.637627:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:11265:x1870624563703680:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 361us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966932.637636:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:1.0:1783966932.637975:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563703808 00000100:00100000:1.0:1783966932.637982:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563703808 00000100:00100000:1.0:1783966932.638034:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1783966932.638044:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:2401:x1870624563703808:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966932.638059:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966932.638084:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ca9 expref: 57 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.638098:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.638101:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966932.638140:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:2401:x1870624563703808:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 98us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966932.638148:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783966932.641099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966932.642464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563704064 00000100:00100000:0.0:1783966932.642484:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563704064 00000100:00100000:0.0:1783966932.642619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1783966932.642648:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:11265:x1870624563704064:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783966932.643922:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:11265:x1870624563704064:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1283us (2830us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1783966932.643957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1783966932.767049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.767396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563704320 00000100:00100000:1.0:1783966932.767410:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563704320 00000100:00100000:1.0:1783966932.767545:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:1.0:1783966932.767558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:11283:x1870624563704320:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1783966932.767595:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966932.767646:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606736a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.768172:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067371 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.768192:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067371 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.768208:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067371 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.768222:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783966932.768370:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606736a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb0 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.768394:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067371 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb0 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.768404:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.768407:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783966932.768430:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e000, rc 0) 00000100:00100000:1.0:1783966932.768644:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11283:x1870624563704320:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1078us (1601us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1783966932.768654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:3.0:1783966932.789969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.790107:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563704448 00000100:00100000:1.0:1783966932.790122:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563704448 00000100:00100000:1.0:1783966932.790209:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:1.0:1783966932.790223:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11284:x1870624563704448:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966932.790256:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966932.790286:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606737f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cb7 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790388:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790406:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790420:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.790475:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783966932.790479:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966932.790504:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790538:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606737f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb7 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790560:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb7 expref: 60 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.790588:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966932.791071:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966932.791077:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e800, rc 0) 00000100:00100000:0.0:1783966932.791238:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11284:x1870624563704448:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1014us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966932.791248:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:3.0:1783966932.800995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.801148:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563704832 00000100:00100000:1.0:1783966932.801163:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563704832 00000100:00100000:1.0:1783966932.801244:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1783966932.801257:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11284:x1870624563704832:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966932.802191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11284:x1870624563704832:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 932us (1208us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1783966932.802202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966932.805957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.806050:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563704960 00000100:00100000:2.0:1783966932.806062:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563704960 00000100:00100000:2.0:1783966932.806155:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1783966932.806167:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11284:x1870624563704960:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:2.0:1783966932.806188:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783966932.806227:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067316 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c9b expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.806257:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067371 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb0 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.806272:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067213 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c55 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.806284:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966932.806290:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966932.806361:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11284:x1870624563704960:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966932.806370:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1783966932.809108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966932.809313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705088 00000100:00100000:2.0:1783966932.809326:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705088 00000100:00100000:2.0:1783966932.809427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:2.0:1783966932.809438:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11284:x1870624563705088:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:2.0:1783966932.809850:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.809876:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966932.809891:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783966932.810229:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783966932.810409:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783966932.810506:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783966932.811174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11284:x1870624563705088:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 1728us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966932.811186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:3.0:1783966932.832329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966932.832463:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705216 00000100:00100000:1.0:1783966932.832476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705216 00000100:00100000:1.0:1783966932.832559:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:1.0:1783966932.832571:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11286:x1870624563705216:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966932.832612:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966932.832968:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067394 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cbe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833073:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833092:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833107:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833147:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833156:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833163:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833269:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833281:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833287:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966932.833338:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783966932.833343:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966932.833368:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833381:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833390:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833396:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833414:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833420:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966932.833425:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833433:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833447:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966932.833450:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966932.833456:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833463:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b31606739b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833479:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833486:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833493:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833498:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966932.833501:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833520:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833528:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:1.0:1783966932.833531:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966932.833534:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833540:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160673a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833573:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067394 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833588:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966932.833596:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:1.0:1783966932.833598:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966932.833601:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f600, rc 0) 00000100:00100000:1.0:1783966932.834330:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11286:x1870624563705216:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1756us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966932.834340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00010000:00010000:1.0:1783966933.047053:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966933.111950:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783966933.112334:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966933.112351:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966933.112393:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783966933.112418:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966933.112611:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587906944:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783966933.112764:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966933.118833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.119058:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587906944:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783966933.120170:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705344 00000100:00100000:3.0:1783966933.120184:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705344 00000100:00100000:3.0:1783966933.120317:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1783966933.120330:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11297:x1870624563705344:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783966933.120375:0:7847:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783966933.120535:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11297:x1870624563705344:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 205us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.120544:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:1.0:1783966933.129068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.129142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705472 00000100:00100000:2.0:1783966933.129155:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705472 00000100:00100000:2.0:1783966933.129238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1783966933.129250:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11297:x1870624563705472:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783966933.129381:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129404:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129418:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129584:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129609:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129623:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129686:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129697:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129704:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966933.129757:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783966933.129762:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966933.129851:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129866:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129889:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129897:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129904:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.129909:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129917:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129941:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:2.0:1783966933.129945:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.129950:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129957:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160673b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129974:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129980:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129986:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.129991:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.130001:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130008:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130017:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9a04c1cca700) 00010000:00010000:2.0:1783966933.130019:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.130022:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130027:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160673b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130043:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130049:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130054:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130059:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.130062:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130068:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966933.130079:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.130100:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.130107:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160673be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.130212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11297:x1870624563705472:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 951us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.130223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1783966933.137716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.137849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705728 00000100:00100000:3.0:1783966933.137863:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705728 00000100:00100000:3.0:1783966933.137966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:3.0:1783966933.137978:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11297:x1870624563705728:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966933.138007:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966933.138036:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cc5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.138186:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.139559:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.139588:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966933.139611:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783966933.139745:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.139754:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.139761:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.140599:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966933.140611:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.140623:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.140659:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:3.0:1783966933.140662:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783966933.140668:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.140675:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.140763:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cc5 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.141815:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:3.0:1783966933.141819:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966933.141829:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cc5 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.141846:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178400, rc 0) 00000100:00100000:3.0:1783966933.141956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563705728:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3978us (4259us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1783966933.141968:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1783966933.146144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.146487:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563705856 00000100:00100000:3.0:1783966933.146501:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563705856 00000100:00100000:1.0:1783966933.146896:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:1.0:1783966933.146939:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563705856:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783966933.146986:0:10203:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783966933.147149:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563705856:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 214us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.147157:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:1.0:1783966933.154227:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.155104:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563706112 00000100:00100000:0.0:1783966933.155122:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563706112 00000100:00100000:0.0:1783966933.155243:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:0.0:1783966933.155257:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563706112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966933.155281:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966933.155285:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783966933.155316:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316067386 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cb7 expref: 60 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.155338:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966933.155344:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966933.155360:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160673da lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ccc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783966933.155809:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783966933.155976:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160673e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.155989:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160673e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.156000:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160673e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.156066:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160673da lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ccc expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.156082:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160673e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ccc expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.156091:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4800) 00010000:00010000:0.0:1783966933.156093:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966933.156096:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0e00, rc 0) 00000100:00100000:0.0:1783966933.157191:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11297:x1870624563706112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1930us (2973us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783966933.157201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1783966933.165212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.165305:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563706368 00000100:00100000:3.0:1783966933.165318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563706368 00000100:00100000:3.0:1783966933.165403:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1783966933.165415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11297:x1870624563706368:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783966933.165500:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966933.165554:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160673e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ccc expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.165577:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4800) 00010000:00010000:3.0:1783966933.165591:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966933.165624:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.165641:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.165654:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166076:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166101:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166114:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166174:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166183:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166190:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166197:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966933.166216:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166225:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166238:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:3.0:1783966933.166242:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966933.166246:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166254:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160673ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166270:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166276:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166282:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166287:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966933.166290:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166296:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166304:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf25aa59f (ffff9a04c3422600) 00010000:00010000:3.0:1783966933.166307:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966933.166316:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.166322:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160673f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf25aa59f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966933.166714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563706368:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1296us (1511us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783966933.166724:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1783966933.182425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.182570:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563706496 00000100:00100000:0.0:1783966933.182582:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563706496 00000100:00100000:0.0:1783966933.182664:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1783966933.182677:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11297:x1870624563706496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966933.182700:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966933.182726:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160673fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cd3 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.182763:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.184048:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.184062:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.184444:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160673fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 62 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.184468:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.184477:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:0.0:1783966933.184480:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966933.184483:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783966933.184552:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11297:x1870624563706496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1877us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.184561:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:2.0:1783966933.190953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.191470:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563706752 00000100:00100000:0.0:1783966933.191485:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563706752 00000100:00100000:0.0:1783966933.191558:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:0.0:1783966933.191571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11297:x1870624563706752:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783966933.191661:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.191679:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.191691:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783966933.192153:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1783966933.192169:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409393398232ns, next at 410393393737ns, rc = 0 00000004:00010000:0.0:1783966933.192410:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f73a729d reply state 00000000e02978ae transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.192427:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.192435:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:0.0:1783966933.192438:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783966933.192441:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966933.192566:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11297:x1870624563706752:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 997us (1626us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783966933.192574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:1.0:1783966933.199702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.200028:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563706880 00000100:00100000:3.0:1783966933.200043:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563706880 00000100:00100000:3.0:1783966933.200133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:3.0:1783966933.200144:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11297:x1870624563706880:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966933.200170:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966933.200191:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cda expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.200494:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.200514:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.200542:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:3.0:1783966933.200547:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783966933.200551:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179400, rc 0) 00000100:00100000:3.0:1783966933.200634:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+64:11297:x1870624563706880:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 491us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.200663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:2.0:1783966933.206844:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.206958:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707008 00000100:00100000:3.0:1783966933.206975:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707008 00000100:00100000:3.0:1783966933.207038:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1783966933.207049:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1870624563707008:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1783966933.207096:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1783966933.207140:0:8433:0:(genops.c:1406:class_connect()) connect: client 4272c10e-7366-407e-b067-e3d2ea5c5b05, cookie 0x9269c8b316067419 00002000:00100000:3.0:1783966933.207169:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4272c10e-7366-407e-b067-e3d2ea5c5b05/ffff9a04c36bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783966933.207199:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1783966933.207315:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783966933.207370:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a04c36bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783966933.207466:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2399:x1870624563707008:12345-192.168.204.59@tcp:8:lhsmtool_posix.0 Request processed in 416us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.207476:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1783966933.216183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.216274:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707136 00000100:00100000:3.0:1783966933.216291:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707136 00000100:00100000:3.0:1783966933.216394:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00080000:1.0:1783966933.216406:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966933.216408:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:0:x1870624563707136:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1783966933.218664:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1783966933.218678:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000100:00100000:3.0:1783966933.219072:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:0:x1870624563707136:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 2660us (2894us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783966933.221439:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783966933.225906:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.228551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707392 00000100:00100000:2.0:1783966933.228574:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707392 00000100:00100000:2.0:1783966933.228667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1783966933.228681:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+64:11297:x1870624563707392:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783966933.229076:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:11297:x1870624563707392:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 396us (3177us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1783966933.229087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1783966933.234512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.234613:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707648 00000001:00080000:3.0:1783966933.234629:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000100:00100000:1.0:1783966933.234631:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707648 00000004:00080000:3.0:1783966933.234648:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1783966933.234738:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000004:00080000:3.0:1783966933.234746:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1783966933.234753:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11297:x1870624563707648:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000020:00080000:3.0:1783966933.234822:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05c3366780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783966933.234828:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05ef0b0a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c3366840 00000020:00080000:3.0:1783966933.234831:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05ef0b0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c3d08a00 00000100:00100000:1.0:1783966933.235015:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11297:x1870624563707648:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 263us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.235023:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:1.0:1783966933.235238:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef20b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587907072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783966933.235298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783966933.235585:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1783966933.235858:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783966933.235885:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587907200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783966933.235959:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966933.236024:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587907072 00000100:00100000:0.0:1783966933.236033:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587907072 00000100:00100000:0.0:1783966933.236096:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587907200 00000100:00100000:0.0:1783966933.236100:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587907200 00000100:00100000:0.0:1783966933.236127:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783966933.236137:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587907072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783966933.236185:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783966933.236200:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587907200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783966933.236229:0:8714:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1783966933.236267:0:8714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a552cd2, atime: 0x6a552cd2, ctime: 0x6a552cd2, blocks: 0x8 00010000:00010000:3.0:1783966933.236276:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.236293:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1783966933.236299:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966933.236306:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.236328:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587907072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (1026us total) trans 4294967303 rc 0/0 00010000:00010000:3.0:1783966933.236533:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.236543:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.236550:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.236568:0:8714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783966933.236720:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587907200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 524us (763us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783966933.236741:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1783966933.236766:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966933.236792:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.236801:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179800 already unused, calling callback (ffffffffc0f10230) 00000100:00080000:1.0:1783966933.238026:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783966933.238035:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783966933.238181:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a05ef20b100/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783966933.238192:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef20b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587907072:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783966933.238410:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.238424:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.238444:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.238453:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a679dffe/0x9269c8b316067420 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.238476:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966933.238478:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966933.238479:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966933.239493:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239512:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239520:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239549:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.239554:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239562:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239583:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a04c3422100) 00010000:00010000:2.0:1783966933.239586:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.239591:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239597:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b31606714f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239633:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239640:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239647:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239654:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.239658:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239664:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239688:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966933.239691:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.239695:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239702:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067156 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239726:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239733:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239740:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239746:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.239750:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239756:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239766:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c3422e00) 00010000:00010000:2.0:1783966933.239788:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.239792:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239799:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067195 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239832:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239839:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239845:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239852:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.239855:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239862:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239872:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966933.239876:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.239880:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239888:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606729f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239900:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239906:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239913:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239937:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.239941:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239947:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239959:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966933.239961:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.239965:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239971:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160672c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239986:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239992:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.239998:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240004:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ee00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.240006:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240013:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240036:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966933.240039:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966933.240043:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240049:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240064:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240071:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240078:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240083:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.240086:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240093:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240101:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:2.0:1783966933.240103:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783966933.240106:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.240111:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606740b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.241325:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:0.0:1783966933.241638:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a05f56ad880/2, rc 0, transno 4294967302 00000100:00100000:0.0:1783966933.241649:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587907200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783966933.242720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.242851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707776 00000100:00100000:2.0:1783966933.242865:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707776 00000100:00100000:3.0:1783966933.243032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1783966933.243117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:11297:x1870624563707776:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966933.243141:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966933.243164:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067427 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ce1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243255:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243271:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243283:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966933.243331:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966933.243353:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243380:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067427 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce1 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243398:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce1 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.243406:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:3.0:1783966933.243409:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783966933.243413:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178a00, rc 0) 00000100:00100000:3.0:1783966933.243478:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563707776:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 369us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.243486:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1783966933.246956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.247011:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563707904 00000100:00100000:1.0:1783966933.247023:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563707904 00000100:00100000:1.0:1783966933.247106:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783966933.247118:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563707904:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966933.247138:0:8714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966933.247162:0:8714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ce8 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783966933.247192:0:8714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552cd4, blocks: 0x0 00010000:00010000:1.0:1783966933.247217:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1783966933.247222:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966933.247233:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 6 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.247255:0:8714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 6 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.247268:0:8714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fa00, rc 0) 00000100:00100000:1.0:1783966933.247348:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563707904:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 233us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.247356:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:2.0:1783966933.258995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.259071:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708160 00000100:00100000:1.0:1783966933.259099:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708160 00000100:00100000:1.0:1783966933.259169:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:1.0:1783966933.259183:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563708160:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783966933.259308:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563708160:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.259347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:0.0:1783966933.272930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.273878:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708288 00000100:00100000:2.0:1783966933.273895:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708288 00000100:00100000:2.0:1783966933.273983:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1783966933.273997:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:11297:x1870624563708288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966933.274023:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966933.274054:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cef expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.274118:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.274130:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966933.274135:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966933.274143:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.274194:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.274225:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.274242:0:8432:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1870624587907328:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966933.274499:0:8432:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9780 going to sleep for 11 seconds 00000100:00100000:0.0:1783966933.283093:0:8432:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1870624587907328:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966933.283136:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.283161:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:0.0:1783966933.283229:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11297:x1870624563708288:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 9234us (10320us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.283240:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:3.0:1783966933.297710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.298181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708416 00000100:00100000:0.0:1783966933.298192:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708416 00010000:00010000:0.0:1783966933.298237:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.298367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1783966933.298378:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563708416:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966933.298395:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966933.298419:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.298434:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.298460:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067435 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce8 expref: 7 pid: 8714 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.298477:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966933.298496:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966933.298505:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.298516:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.298556:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.298572:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1870624587907456:192.168.204.59@tcp:105: 00000100:00100000:0.0:1783966933.298665:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966933.305727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.306026:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708544 00000100:00100000:2.0:1783966933.306037:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708544 00002000:00100000:2.0:1783966933.306091:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a05f56ac000 x1870624563708544/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:94/0 lens 504/0 e 0 to 0 dl 1783966944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783966933.306102:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a05f56ac000 with x1870624563708544 ext(0->8) 00002000:00010000:2.0:1783966933.306108:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a05f56ac000 00000100:00100000:2.0:1783966933.306147:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1783966933.306157:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563708544:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783966933.306724:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1870624587907456:192.168.204.59@tcp:105: 00010000:00010000:2.0:1783966933.306745:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966933.307311:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563708416:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 8932us (9609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.307320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1783966933.309693:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563708544:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 3522us (3964us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783966933.309724:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:3.0:1783966933.309744:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a05f56ac000 x1870624563708544/t4294967304(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:94/0 lens 504/448 e 0 to 0 dl 1783966944 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966933.309757:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a05f56ac000 with x1870624563708544 ext(0->8) 00002000:00010000:3.0:1783966933.309765:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a05f56ac000 00000100:00100000:0.0:1783966933.313579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.313727:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708672 00000100:00100000:3.0:1783966933.313746:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708672 00000100:00100000:3.0:1783966933.313860:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1783966933.313873:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563708672:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1783966933.314074:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563708672:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 204us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.314083:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1783966933.317523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.317606:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563708800 00000100:00100000:3.0:1783966933.317625:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563708800 00000100:00100000:3.0:1783966933.317705:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1783966933.317718:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563708800:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783966933.324793:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1783966933.324828:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1783966933.325046:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563708800:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 7316us (7518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.325061:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1783966933.345154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.345395:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709056 00000100:00100000:1.0:1783966933.345408:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709056 00000100:00100000:1.0:1783966933.345486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1783966933.345499:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563709056:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783966933.345574:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966933.345611:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606742e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ce1 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.345636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:1.0:1783966933.345642:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966933.345685:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.345701:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.345713:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966933.345907:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092dfd4a7 reply state 00000000c6400ac4 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.345932:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.345960:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:1.0:1783966933.345962:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783966933.345965:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783966933.346118:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:11297:x1870624563709056:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 621us (981us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1783966933.346126:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:0.0:1783966933.353807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.353926:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709184 00000100:00100000:1.0:1783966933.353941:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709184 00000100:00100000:1.0:1783966933.354016:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1783966933.354039:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563709184:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783966933.354276:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783966933.354281:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783966931 00002000:00010000:1.0:1783966933.354283:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783966930 00002000:00010000:1.0:1783966933.354286:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783966932 -> 1783966931 00002000:00010000:1.0:1783966933.354288:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1783966933.354386:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563709184:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 349us (620us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783966933.354395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1783966933.357885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.357939:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709440 00000100:00100000:3.0:1783966933.357951:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709440 00000100:00100000:3.0:1783966933.358009:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1783966933.358029:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:11297:x1870624563709440:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783966933.358111:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.358145:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 15 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.358155:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.358198:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 15 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.358213:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 15 pid: 7847 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966933.358231:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587907584:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966933.358330:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783966933.364678:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587907584:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966933.364718:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.373711:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966933.373743:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587907712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966933.373863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966933.373939:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587907712 00000100:00100000:2.0:1783966933.373950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587907712 00000100:00100000:2.0:1783966933.374010:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783966933.374022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587907712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783966933.374088:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783966933.374144:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587907712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.374151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783966933.374206:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587907712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966933.382322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.382903:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709568 00000100:00100000:3.0:1783966933.382927:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709568 00010000:00010000:3.0:1783966933.382986:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 16 pid: 7847 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966933.383258:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1783966933.383271:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:2401:x1870624563709568:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966933.383292:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966933.383302:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 16 pid: 7847 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383318:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 16 pid: 7847 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383366:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cd3 expref: 16 pid: 7847 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383382:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:3.0:1783966933.383390:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383403:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383412:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.383458:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966933.383534:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:2401:x1870624563709568:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 265us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966933.383543:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00010000:00010000:2.0:1783966933.383843:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383853:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383906:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383914:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383932:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383939:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.383945:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383954:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383964:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:2.0:1783966933.383967:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783966933.383971:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.383987:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b31606744a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.384041:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563709440:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 26023us (26170us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783966933.384051:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:3.0:1783966933.389733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.389898:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709696 00000100:00100000:0.0:1783966933.389909:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709696 00000100:00100000:0.0:1783966933.389974:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1783966933.389986:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563709696:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783966933.390035:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.390058:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.390081:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966933.390086:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966933.390091:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.390129:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.390144:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 7 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.390159:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587907840:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966933.390244:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4300 going to sleep for 11 seconds 00000100:00100000:2.0:1783966933.405481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.405618:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587907840:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966933.405658:0:8714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966933.405827:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563709824 00000100:00100000:1.0:1783966933.405836:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563709824 00010000:00010000:1.0:1783966933.405893:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 8 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966933.406149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1783966933.406312:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563709824:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966933.406337:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966933.406366:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 8 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.406396:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 8 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.406422:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a60beaf/0x9269c8b31606743c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cef expref: 8 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.406456:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966933.406461:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966933.406468:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.406478:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.406512:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966933.406585:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563709824:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 413us (1105us total) trans 0 rc 0/0 00010000:00010000:0.0:1783966933.406641:0:8714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406653:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406686:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406708:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406719:0:8714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406728:0:8714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966933.406732:0:8714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406742:0:8714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406761:0:8714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.406796:0:8714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000556a2d05/0x9269c8b316067451 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.406881:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563709696:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 16895us (17155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.406891:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1783966933.409317:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1783966933.410690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.411149:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710080 00000100:00100000:1.0:1783966933.411166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710080 00000100:00100000:1.0:1783966933.411274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:1.0:1783966933.411289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11297:x1870624563710080:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783966933.411397:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.411420:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.411433:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.411479:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.411494:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 14 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966933.411510:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587907968:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966933.411619:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966933.421454:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f1a26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587907968:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966933.421487:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.422502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.422702:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710208 00000100:00100000:0.0:1783966933.422718:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710208 00010000:00010000:0.0:1783966933.422827:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.422900:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:0.0:1783966933.422911:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:2401:x1870624563710208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966933.422949:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966933.423404:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423429:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067298 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c78 expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423481:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966933.423488:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423501:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423511:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.423547:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966933.423605:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.423619:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.423633:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:2401:x1870624563710208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 720us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.423651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00010000:00010000:2.0:1783966933.424242:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.424261:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.424270:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.424309:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.424337:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 14 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.424352:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587908096:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966933.424440:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783966933.432349:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587908096:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966933.432393:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966933.433293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.434155:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710336 00000100:00100000:1.0:1783966933.434170:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710336 00010000:00010000:1.0:1783966933.434232:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966933.434286:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1783966933.434319:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:2400:x1870624563710336:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966933.434340:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966933.434348:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434363:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434392:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cda expref: 15 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434415:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:1.0:1783966933.434431:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434443:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434451:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.434487:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966933.434566:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:2400:x1870624563710336:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 250us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.434575:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00010000:00010000:3.0:1783966933.436295:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966933.436314:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783966933.436622:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1783966933.436753:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1783966933.437179:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1783966933.437278:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1870624587908224:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783966933.437349:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966933.437381:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966933.440060:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587908224 00000100:00100000:2.0:1783966933.440075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587908224 00000100:00100000:2.0:1783966933.440160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783966933.440172:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1870624587908224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783966933.440306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1870624587908224:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.440314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783966933.440344:0:6517:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1783966933.440351:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a05ef20b100, transno 4294967303 00000100:00100000:3.0:1783966933.440386:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1870624587908224:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1783966933.440696:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1783966933.441140:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c357b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1870624587908352:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783966933.441259:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966933.441285:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3605e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783966933.454007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587908352 00000100:00100000:0.0:1783966933.454039:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587908352 00000100:00100000:0.0:1783966933.454111:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783966933.454123:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1870624587908352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783966933.454354:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1870624587908352:12345-0@lo:1000:mdt00_000.0 Request processed in 234us (13096us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783966933.454364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783966933.454402:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c357b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1870624587908352:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783966933.454469:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454480:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454487:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454493:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.454499:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454524:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454541:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:2.0:1783966933.454545:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783966933.454550:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454556:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b31606745f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454593:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454600:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454606:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454611:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.454615:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454621:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454631:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:2.0:1783966933.454633:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783966933.454638:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454655:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606738d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454681:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454696:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454706:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454742:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.454756:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 17 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.454800:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587908480:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966933.455050:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966933.464985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.465021:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587908480:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966933.465067:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.465143:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710464 00000100:00100000:0.0:1783966933.465155:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710464 00010000:00010000:0.0:1783966933.465202:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 18 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.465251:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:0.0:1783966933.465260:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2400:x1870624563710464:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966933.465279:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966933.465288:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 18 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465302:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 18 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465330:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160673a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cbe expref: 18 pid: 6518 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465349:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966933.465355:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465367:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465398:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465426:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966933.465485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:2400:x1870624563710464:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 225us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.465494:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00010000:00010000:0.0:1783966933.465552:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465561:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465575:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465582:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465590:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465598:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966933.465603:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465612:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465623:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966933.465627:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966933.465637:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465644:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067466 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465656:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465662:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465668:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465673:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966933.465676:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465682:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465689:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465200) 00010000:00010000:0.0:1783966933.465692:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966933.465694:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.465700:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067458 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.465927:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11297:x1870624563710080:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 54630us (55229us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783966933.465938:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000020:00080000:0.0:1783966933.465947:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783966933.466027:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783966933.466098:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783966933.466126:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783966933.466137:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783966933.475485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.476440:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710720 00000100:00100000:1.0:1783966933.476454:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710720 00000100:00100000:1.0:1783966933.476522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783966933.476530:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11297:x1870624563710720:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783966933.476816:0:6520:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783966933.476849:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1783966933.476884:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476902:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476924:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476933:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476940:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476945:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.476965:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783966933.477848:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:11297:x1870624563710720:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1313us (2374us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1783966933.477871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000020:00080000:1.0:1783966933.477878:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783966933.477906:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966933.477912:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.477933:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966933.477937:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.477946:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.477959:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:1.0:1783966933.477962:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783966933.477966:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.477971:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606746d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.477984:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966933.477986:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966933.477987:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966933.638389:0:14211:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966933.638405:0:14211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966933.638432:0:14211:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783966933.638439:0:14211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783966933.774998:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.775065:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563710976 00000100:00100000:1.0:1783966933.775079:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563710976 00000100:00100000:1.0:1783966933.775158:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:1.0:1783966933.775171:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:11307:x1870624563710976:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966933.775204:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966933.775234:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cf6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.775395:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606747b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.775415:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606747b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.775430:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606747b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966933.775444:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783966933.776485:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cf6 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.776522:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606747b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cf6 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.776534:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966933.776538:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783966933.776543:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e800, rc 0) 00000100:00100000:1.0:1783966933.776633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:11307:x1870624563710976:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1463us (1649us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1783966933.776644:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:3.0:1783966933.782876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966933.783018:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563711104 00000100:00100000:1.0:1783966933.783031:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563711104 00000100:00100000:1.0:1783966933.783101:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:1.0:1783966933.783112:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:11307:x1870624563711104:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1783966933.783212:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783242:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783258:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783279:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783287:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783295:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783394:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783402:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783408:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966933.783468:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783482:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783489:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783506:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783513:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966933.783517:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783526:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783541:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966933.783544:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966933.783549:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783555:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067489 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783569:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783575:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783581:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783587:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966933.783590:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783606:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783615:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465500) 00010000:00010000:1.0:1783966933.783617:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966933.783620:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783626:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067490 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783640:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783647:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783653:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783658:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966933.783661:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783667:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783674:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966933.783676:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966933.783679:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966933.783694:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067497 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966933.783821:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:11307:x1870624563711104:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 709us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966933.783830:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:3.0:1783966933.855917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.855976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563711360 00000100:00100000:0.0:1783966933.855990:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563711360 00000100:00100000:0.0:1783966933.856316:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:0.0:1783966933.856328:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:11310:x1870624563711360:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966933.856353:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966933.856378:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606749e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6cfd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856497:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856512:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856528:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856535:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856542:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856679:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856687:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856715:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966933.856729:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783966933.856882:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856889:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856896:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856903:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966933.856919:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856928:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856942:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966933.856945:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966933.856950:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856956:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160674a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856971:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856976:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.856989:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857004:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966933.857009:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857016:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857025:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05ed1b4500) 00010000:00010000:0.0:1783966933.857027:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966933.857030:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857036:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857081:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606749e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.857103:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966933.857105:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966933.857108:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0c00, rc 0) 00000100:00100000:0.0:1783966933.857195:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11310:x1870624563711360:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 868us (1302us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1783966933.857212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:1.0:1783966933.862824:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.862924:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563711488 00000100:00100000:3.0:1783966933.862938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563711488 00000100:00100000:2.0:1783966933.863123:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1783966933.863138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11310:x1870624563711488:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1783966933.864362:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864405:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864420:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864468:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864474:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864482:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864489:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966933.864494:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864502:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864516:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966933.864519:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783966933.864524:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.864531:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.864636:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11310:x1870624563711488:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 1498us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.864651:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:3.0:1783966933.875033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.875164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563711744 00000100:00100000:2.0:1783966933.875178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563711744 00000100:00100000:2.0:1783966933.875309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1783966933.875322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11310:x1870624563711744:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783966933.875697:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:11310:x1870624563711744:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 377us (677us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1783966933.875707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1783966933.914275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966933.914560:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712000 00000100:00100000:3.0:1783966933.915034:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712000 00000100:00100000:2.0:1783966933.915263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1783966933.915277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:10836:x1870624563712000:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966933.915311:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966933.915338:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.915486:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.915505:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.915516:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.915563:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.915618:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 24 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966933.916164:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587908608:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966933.916313:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9900 going to sleep for 11 seconds 00000100:00100000:3.0:1783966933.920057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.920219:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587908608:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966933.920260:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.920444:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712128 00000100:00100000:0.0:1783966933.920454:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712128 00010000:00010000:0.0:1783966933.920509:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 25 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966933.920761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1783966933.920824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:2400:x1870624563712128:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966933.920846:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966933.920857:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 25 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.920872:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 25 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.920900:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b3160674b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cfd expref: 25 pid: 6517 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.920930:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966933.920936:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.920946:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.920955:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.921007:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966933.921097:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:2400:x1870624563712128:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 324us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.921106:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00010000:00010000:2.0:1783966933.921169:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.921176:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966933.921196:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783966933.921375:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.921389:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.921395:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966933.921397:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783966933.921399:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966933.921425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:10836:x1870624563712000:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6153us (7167us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1783966933.921444:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:1.0:1783966933.924569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.924946:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712256 00000100:00100000:0.0:1783966933.924960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712256 00000100:00100000:0.0:1783966933.925078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1783966933.925092:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:10836:x1870624563712256:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966933.925126:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966933.925154:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160674dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d0b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925200:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925217:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925230:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925385:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b3160674dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d0b expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925407:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d0b expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.925418:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966933.925429:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966933.925434:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0600, rc 0) 00000100:00100000:0.0:1783966933.925524:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:10836:x1870624563712256:12345-192.168.204.59@tcp:101:bash.0 Request processed in 434us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.925532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:3.0:1783966933.928050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.928493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712512 00000100:00100000:2.0:1783966933.928587:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712512 00000100:00100000:2.0:1783966933.928666:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:2.0:1783966933.928679:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:10836:x1870624563712512:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:2.0:1783966933.929066:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.929088:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.929102:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783966933.929154:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1783966933.929180:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000008e788ee reply state 0000000010612cf0 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.929196:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.929205:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966933.929208:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966933.929213:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783966933.929254:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1783966933.929378:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:10836:x1870624563712512:12345-192.168.204.59@tcp:36:bash.0 Request processed in 699us (1341us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783966933.929387:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000020:00080000:2.0:1783966933.929393:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783966933.932069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966933.932574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712640 00000100:00100000:2.0:1783966933.932590:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712640 00000100:00100000:2.0:1783966933.932680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:2.0:1783966933.932691:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:10836:x1870624563712640:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966933.932726:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966933.932754:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.932883:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d12 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.932901:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d12 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966933.932939:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966933.932942:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783966933.932947:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783966933.933024:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:10836:x1870624563712640:12345-192.168.204.59@tcp:101:bash.0 Request processed in 333us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966933.933033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:1.0:1783966933.936820:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.936939:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712768 00000100:00100000:0.0:1783966933.936952:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712768 00000100:00100000:0.0:1783966933.937079:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:0.0:1783966933.937092:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:10836:x1870624563712768:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966933.937117:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966933.937144:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d19 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783966933.937184:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a552cd3, atime: 0x6a552cd2, ctime: 0x6a552cd3, blocks: 0x8 00010000:00010000:0.0:1783966933.937216:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783966933.937222:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966933.937232:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.937254:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966933.937271:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1200, rc 0) 00000100:00100000:0.0:1783966933.937353:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:10836:x1870624563712768:12345-192.168.204.59@tcp:101:bash.0 Request processed in 263us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966933.937362:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1783966933.940030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966933.940165:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563712896 00000100:00100000:0.0:1783966933.940177:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563712896 00002000:00010000:0.0:1783966933.940237:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1783966933.940243:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a05f56ebb80 with x1870624563712896 ext(0->18446744073709551615) 00002000:00010000:0.0:1783966933.940259:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a05f56ebb80. 00000100:00100000:0.0:1783966933.940336:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1783966933.940347:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563712896:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:0.0:1783966933.940750:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783966933.940755:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783966931 -> 1783966933 00002000:00010000:0.0:1783966933.940758:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783966930 -> 1783966930 00002000:00010000:0.0:1783966933.940760:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783966931 -> 1783966933 00002000:00010000:0.0:1783966933.940763:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783966933.940884:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563712896:12345-192.168.204.59@tcp:10:bash.0 Request processed in 537us (866us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783966933.940892:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00010000:0.0:1783966933.940896:0:8437:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1783966933.940899:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a05f56ebb80 with x1870624563712896 ext(0->18446744073709551615) 00002000:00010000:0.0:1783966933.940916:0:8437:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a05f56ebb80. 00000100:00100000:3.0:1783966934.014723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.015498:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563713024 00000100:00100000:2.0:1783966934.015513:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563713024 00000100:00100000:2.0:1783966934.015634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:2.0:1783966934.015647:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11324:x1870624563713024:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:2.0:1783966934.015755:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.015805:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.015842:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.015863:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.015873:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.015880:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016003:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016015:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016022:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966934.016086:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016100:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016107:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016115:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016133:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.016138:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016147:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016163:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.016166:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.016172:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016179:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067500 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016194:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016200:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016206:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016211:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.016214:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016220:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016239:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c1cca700) 00010000:00010000:2.0:1783966934.016242:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.016245:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016251:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016266:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016273:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016279:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016284:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.016287:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016293:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016300:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966934.016303:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.016306:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.016493:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b31606750e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.016616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11324:x1870624563713024:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 968us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.016626:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00080000:1.0:1783966934.016723:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966934.055869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.055969:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563713280 00000100:00100000:2.0:1783966934.055983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563713280 00000100:00100000:2.0:1783966934.056080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1783966934.056092:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11327:x1870624563713280:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966934.056121:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.056149:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067515 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056253:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056284:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056298:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056328:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056337:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056343:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056513:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606752a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056524:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606752a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056532:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606752a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.056544:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783966934.056652:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056660:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056668:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056674:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.056679:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056686:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056701:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.056704:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.056709:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056726:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606751c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056743:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056748:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056754:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056760:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.056763:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056844:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056853:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c1cca700) 00010000:00010000:2.0:1783966934.056856:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.056859:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056865:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056926:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d20 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056942:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606752a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d20 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.056957:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966934.056959:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783966934.056963:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630200, rc 0) 00000100:00100000:2.0:1783966934.057052:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11327:x1870624563713280:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 961us (1196us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783966934.057061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1783966934.066289:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.066399:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563713408 00000100:00100000:1.0:1783966934.066412:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563713408 00000100:00100000:1.0:1783966934.066503:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:1.0:1783966934.066516:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11327:x1870624563713408:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783966934.066616:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.066637:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.066650:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.066704:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.066720:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 32 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.066761:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587908736:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966934.066955:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05db5ba3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783966934.071186:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966934.072226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.073281:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587908736:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966934.073992:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.074191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563713664 00000100:00100000:2.0:1783966934.074201:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563713664 00000100:00100000:2.0:1783966934.074326:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1783966934.074338:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:6172:x1870624563713664:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783966934.074746:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:6172:x1870624563713664:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 407us (2527us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1783966934.074755:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1783966934.081383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.081583:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563713792 00000100:00100000:2.0:1783966934.081596:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563713792 00010000:00010000:2.0:1783966934.081657:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 34 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.081854:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783966934.081868:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:2400:x1870624563713792:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966934.081890:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966934.081899:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 34 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.081947:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 34 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.081977:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160674cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d04 expref: 34 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.081998:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966934.082005:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.082186:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.082197:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083596:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083615:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.083626:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966934.083680:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083690:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083699:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083706:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.083713:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083721:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.083732:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:2400:x1870624563713792:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1860us (2426us total) trans 0 rc 0/0 00010000:00010000:1.0:1783966934.083740:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00000100:00100000:2.0:1783966934.083746:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00010000:00010000:1.0:1783966934.083935:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783966934.083942:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.083949:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067538 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.084007:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11327:x1870624563713408:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 17494us (17734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.084018:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:1.0:1783966934.089943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.090098:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563714048 00000100:00100000:3.0:1783966934.090112:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563714048 00000100:00100000:3.0:1783966934.090191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783966934.090204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:11327:x1870624563714048:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783966934.090523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:11327:x1870624563714048:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 321us (605us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1783966934.090532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783966934.195406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.195663:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563714304 00000100:00100000:2.0:1783966934.195678:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563714304 00000100:00100000:2.0:1783966934.195768:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:2.0:1783966934.195830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+33:11338:x1870624563714304:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1783966934.195862:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.195889:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606753f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d27 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196017:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196037:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196051:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196069:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196076:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196083:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196226:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067554 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196242:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196249:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.196261:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783966934.196357:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196366:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196380:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196387:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.196392:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196401:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196415:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.196419:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.196425:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196432:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196448:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196454:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196459:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196464:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.196467:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196484:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196494:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c1cca700) 00010000:00010000:2.0:1783966934.196496:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.196499:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196505:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b31606754d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196556:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606753f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d27 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196573:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d27 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.196580:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966934.196583:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966934.196586:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783966934.196683:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11338:x1870624563714304:12345-192.168.204.59@tcp:101:cat.0 Request processed in 854us (1290us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783966934.196695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:3.0:1783966934.201224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.201284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563714560 00000100:00100000:2.0:1783966934.201298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563714560 00000100:00100000:2.0:1783966934.201379:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1783966934.201393:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11338:x1870624563714560:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:2.0:1783966934.201884:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:11338:x1870624563714560:12345-192.168.204.59@tcp:35:cat.0 Request processed in 492us (795us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783966934.201895:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1783966934.247971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.248118:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563714816 00000100:00100000:1.0:1783966934.248132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563714816 00000100:00100000:1.0:1783966934.248210:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:1.0:1783966934.248225:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:11339:x1870624563714816:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:1.0:1783966934.248320:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1783966934.248360:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160674f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d12 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248390:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067554 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d27 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248596:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606752a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d20 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248612:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b3160674e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d0b expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248634:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:1.0:1783966934.248650:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966934.248690:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248708:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248721:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248738:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248745:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248751:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248930:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248941:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.248947:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783966934.249250:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1783966934.249518:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410450747037ns, next at 411450743253ns, rc = 0 00010000:00010000:1.0:1783966934.249581:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249606:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249615:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249623:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249631:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249638:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249681:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783966934.249706:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249713:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249719:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249725:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ec00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.249731:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249739:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249760:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:1.0:1783966934.249763:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783966934.249804:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067570 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249829:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249836:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249842:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249848:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.249851:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249857:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249864:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966934.249867:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966934.249870:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249876:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b316067562 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966934.249897:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002230d1b1 reply state 000000006afd1854 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249925:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.249932:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:1.0:1783966934.249934:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783966934.249938:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783966934.250068:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:11339:x1870624563714816:12345-192.168.204.59@tcp:36:rm.0 Request processed in 1842us (2107us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783966934.250079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00010000:00010000:3.0:1783966934.250688:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966934.250698:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.250706:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966934.250710:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.250717:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.250730:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:3.0:1783966934.250733:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783966934.250736:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.250742:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067577 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.250754:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966934.250756:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966934.250758:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966934.274645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.274707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.274826:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563714944 00000100:00100000:1.0:1783966934.274841:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563714944 00000100:00100000:1.0:1783966934.274932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 384 00000100:00100000:1.0:1783966934.274947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563714944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966934.275062:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563714944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 119us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.275072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 384 00000100:00100000:1.0:1783966934.275415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.279068:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715072 00000100:00100000:2.0:1783966934.279089:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715072 00000100:00080000:3.0:1783966934.279214:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966934.280048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.280072:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715328 00000100:00100000:2.0:1783966934.280080:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715328 00000100:00100000:1.0:1783966934.280089:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.280153:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715200 00000100:00100000:3.0:1783966934.280159:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715200 00000100:00100000:3.0:1783966934.280209:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1783966934.280221:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563715200:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966934.280329:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563715200:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.280338:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00080000:3.0:1783966934.280368:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966934.280389:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966934.281084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715456 00000100:00100000:0.0:1783966934.281093:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715456 00000100:00080000:0.0:1783966934.281119:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966934.281159:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:0.0:1783966934.281177:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563715072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966934.281233:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563715072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 58us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.281242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 301 00000100:00100000:0.0:1783966934.281258:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00100000:0.0:1783966934.281265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563715328:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966934.281302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563715328:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (5889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.281308:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 302 00000100:00100000:0.0:1783966934.281320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 303 00000100:00100000:0.0:1783966934.281326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563715456:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966934.281352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563715456:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.281359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 303 00000100:00100000:1.0:1783966934.315224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.315528:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715712 00000100:00100000:0.0:1783966934.315543:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715712 00000100:00100000:0.0:1783966934.315643:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1783966934.315656:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:11345:x1870624563715712:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966934.315691:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966934.315719:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b31606757e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d2e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316063:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316099:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316114:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316128:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316136:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.316142:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783966934.317649:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1783966934.318094:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318114:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318128:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318480:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318489:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318496:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318522:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966934.318528:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318536:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318554:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966934.318558:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966934.318564:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318681:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067585 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966934.318701:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043fd4a1f reply state 000000009ec393c4 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318715:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.318721:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:0.0:1783966934.318724:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966934.318728:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783966934.318990:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b31606757e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.319010:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.319033:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:0.0:1783966934.319036:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966934.319039:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783966934.319280:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:11345:x1870624563715712:12345-192.168.204.59@tcp:101:bash.0 Request processed in 3625us (4070us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783966934.319291:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:0.0:1783966934.323954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.324071:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715840 00000100:00100000:2.0:1783966934.324084:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715840 00000100:00100000:2.0:1783966934.324158:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1783966934.324171:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563715840:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966934.324197:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.324225:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d35 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783966934.324259:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783966934.324287:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1783966934.324293:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966934.324306:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.324330:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.324348:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966934.324429:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563715840:12345-192.168.204.59@tcp:101:bash.0 Request processed in 259us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.324460:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1783966934.328339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.328451:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563715968 00000100:00100000:3.0:1783966934.328465:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563715968 00000100:00100000:3.0:1783966934.328546:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1783966934.328558:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:11345:x1870624563715968:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966934.328598:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966934.328625:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d3c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.328673:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.328684:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966934.328688:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966934.328695:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.328746:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.328764:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966934.328826:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1870624587908864:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966934.328983:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c900 going to sleep for 11 seconds 00000100:00100000:3.0:1783966934.335484:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1870624587908864:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966934.339630:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.339680:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1000, rc 0) 00000100:00100000:2.0:1783966934.340107:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:11345:x1870624563715968:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11546us (11780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.340120:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:3.0:1783966934.345877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.351438:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563716096 00000100:00100000:2.0:1783966934.351462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563716096 00010000:00010000:2.0:1783966934.351534:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.351996:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:2.0:1783966934.352012:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563716096:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966934.352041:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966934.352075:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.352095:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.352129:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b3160675a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d35 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.352152:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966934.352157:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966934.352168:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.352204:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.352264:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.352281:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f63df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1870624587908992:192.168.204.59@tcp:105: 00000100:00100000:2.0:1783966934.352489:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966934.367496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.367696:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563716352 00000100:00100000:3.0:1783966934.367708:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563716352 00000100:00100000:3.0:1783966934.367833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1783966934.367845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:11345:x1870624563716352:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1783966934.368284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11345:x1870624563716352:12345-192.168.204.59@tcp:35:bash.0 Request processed in 440us (803us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1783966934.368293:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:2.0:1783966934.368590:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f63df800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1870624587908992:192.168.204.59@tcp:105: 00010000:00010000:2.0:1783966934.368624:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966934.368652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563716096:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 16646us (22883us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.368662:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1783966934.510907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.511645:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563716480 00000100:00100000:3.0:1783966934.511664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563716480 00000100:00100000:3.0:1783966934.511755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:3.0:1783966934.511975:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:11361:x1870624563716480:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966934.512152:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.512185:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160675af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d43 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512301:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512316:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.512413:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783966934.512418:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966934.512446:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512479:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160675af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d43 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512505:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d43 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.512515:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.512519:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966934.512523:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630e00, rc 0) 00000100:00100000:2.0:1783966934.512618:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:11361:x1870624563716480:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 851us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.512627:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:0.0:1783966934.520073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.520549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563716736 00000100:00100000:1.0:1783966934.520574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563716736 00000100:00100000:1.0:1783966934.520671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:1.0:1783966934.520684:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:11361:x1870624563716736:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966934.520712:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966934.520738:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b3160675bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d4a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.521110:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160675c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.521130:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160675c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.521147:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160675c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966934.521161:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783966934.521308:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b3160675bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d4a expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.521332:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160675c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d4a expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.521343:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:1.0:1783966934.521346:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966934.521351:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966934.521441:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:11361:x1870624563716736:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 758us (1393us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1783966934.521450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:1.0:1783966934.526103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.526186:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.526615:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563716992 00000100:00100000:0.0:1783966934.526628:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563716992 00000100:00100000:0.0:1783966934.526702:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:0.0:1783966934.526714:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:11361:x1870624563716992:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966934.526746:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966934.526814:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160675d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d51 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.527108:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717120 00000100:00100000:2.0:1783966934.527113:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717120 00000100:00100000:2.0:1783966934.527159:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783966934.527167:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:2400:x1870624563717120:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966934.527179:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966934.527205:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160675c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d4a expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.527225:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:2.0:1783966934.527241:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966934.527309:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:2400:x1870624563717120:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 143us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.527318:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:0.0:1783966934.529374:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.529407:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.529422:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966934.529447:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783966934.529670:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160675d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d51 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.529693:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d51 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.529703:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:0.0:1783966934.529706:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783966934.529710:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0000, rc 0) 00000100:00100000:0.0:1783966934.529814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:11361:x1870624563716992:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3101us (3723us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1783966934.529831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 110 00000100:00100000:1.0:1783966934.538170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.538310:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717248 00000100:00100000:0.0:1783966934.538323:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717248 00000100:00100000:0.0:1783966934.538402:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:0.0:1783966934.538414:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563717248:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:0.0:1783966934.538477:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.538518:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.538529:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966934.538536:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966934.538542:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.538594:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.538631:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 8 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966934.538651:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1870624587909120:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966934.539165:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783966934.542182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.542330:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1870624587909120:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966934.542352:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717376 00000100:00100000:3.0:1783966934.542363:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717376 00010000:00010000:0.0:1783966934.542369:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1783966934.542436:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a04c443fb80 x1870624563717376/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:95/0 lens 504/0 e 0 to 0 dl 1783966945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966934.542506:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c443fb80 with x1870624563717376 ext(0->8) 00010000:00010000:3.0:1783966934.542515:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 9 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.542531:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 9 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783966934.542563:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c443fb80 00000100:00100000:3.0:1783966934.542649:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1783966934.542660:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563717376:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:3.0:1783966934.544052:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2400:x1870624563717376:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 1382us (1878us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783966934.544066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00002000:00100000:3.0:1783966934.544079:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a04c443fb80 x1870624563717376/t4294967303(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:95/0 lens 504/448 e 0 to 0 dl 1783966945 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966934.544091:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c443fb80 with x1870624563717376 ext(0->8) 00010000:00010000:3.0:1783966934.544101:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.544121:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783966934.544129:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c443fb80 00000100:00100000:2.0:1783966934.547103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.547227:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717504 00000100:00100000:1.0:1783966934.547240:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717504 00010000:00010000:1.0:1783966934.547297:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.547450:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1783966934.547462:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2401:x1870624563717504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966934.547482:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1783966934.547510:0:13736:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783966934.547514:0:13736:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783966933 00002000:00010000:1.0:1783966934.547516:0:13736:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783966933 00002000:00010000:1.0:1783966934.547519:0:13736:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783966933 00002000:00010000:1.0:1783966934.547521:0:13736:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1783966934.547529:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.547545:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.547585:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b3160675a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d3c expref: 11 pid: 8433 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.547608:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783966934.547613:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783966934.547652:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.547665:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.547707:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966934.547848:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547860:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547883:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547901:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547911:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547932:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966934.547937:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547948:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547961:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.547970:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b3160675e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.548196:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2401:x1870624563717504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 734us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.548206:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:0.0:1783966934.548505:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563717248:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 10092us (10351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.548513:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1783966934.551616:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.554236:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717760 00000100:00100000:3.0:1783966934.554261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717760 00000100:00100000:3.0:1783966934.554407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1783966934.554421:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:11361:x1870624563717760:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:3.0:1783966934.554522:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d51 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783966934.555240:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1783966934.555307:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783966934.555950:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1783966934.556008:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.556031:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.556042:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.556094:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.556114:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 46 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966934.556134:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587909248:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966934.556271:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783966934.560176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.561174:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587909248:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966934.561211:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966934.561463:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563717888 00000100:00100000:0.0:1783966934.561472:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563717888 00010000:00010000:2.0:1783966934.561715:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 47 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.561958:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1783966934.561970:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:2400:x1870624563717888:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966934.561989:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966934.561998:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 47 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562011:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 47 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562040:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d2e expref: 47 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562059:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:2.0:1783966934.562065:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562076:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562107:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.562180:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966934.562259:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+46:2400:x1870624563717888:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 291us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.562267:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00010000:00010000:0.0:1783966934.563463:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.563479:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966934.564048:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1783966934.564212:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1783966934.564342:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587909376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783966934.564447:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966934.564500:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966934.564738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587909376 00000100:00100000:3.0:1783966934.564747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587909376 00000100:00100000:3.0:1783966934.564885:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783966934.564906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587909376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783966934.565007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587909376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 113us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.565027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783966934.565127:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587909376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783966934.565266:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1783966934.565321:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587909504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783966934.565354:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966934.565379:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966934.565469:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587909504 00000100:00100000:3.0:1783966934.565473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587909504 00000100:00100000:3.0:1783966934.565491:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783966934.565497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587909504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783966934.565615:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6521:x1870624587909504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (260us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783966934.565622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783966934.565966:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587909504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783966934.566020:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1783966934.566066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566079:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566087:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566095:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.566110:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566118:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566139:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:1.0:1783966934.566142:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783966934.566147:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.566154:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b3160675ee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783966934.566294:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783966934.566378:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1783966934.566391:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410767620913ns, next at 411767617884ns, rc = 0 00000001:00080000:1.0:1783966934.566398:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1783966934.566424:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05ed1b4000) 00010000:00010000:1.0:1783966934.566427:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783966934.566436:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160675d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d51 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.566599:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:11361:x1870624563717760:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 12181us (15054us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1783966934.566610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000020:00080000:1.0:1783966934.566616:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783966934.569730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.569891:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563718016 00000100:00100000:1.0:1783966934.569912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563718016 00000100:00100000:1.0:1783966934.569984:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00100000:1.0:1783966934.569995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:11361:x1870624563718016:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966934.570044:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966934.570074:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160675f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.570146:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160675f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d58 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.570163:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160675f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d58 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.570184:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966934.570187:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966934.570192:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f600, rc 0) 00000100:00100000:1.0:1783966934.570267:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:11361:x1870624563718016:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 274us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.570274:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 111 00000100:00100000:3.0:1783966934.572905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.573073:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563718272 00000100:00100000:1.0:1783966934.573086:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563718272 00000100:00100000:1.0:1783966934.573154:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:1.0:1783966934.573166:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:11361:x1870624563718272:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966934.573501:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:11361:x1870624563718272:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 335us (616us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1783966934.573510:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783966934.668511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.668653:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563718400 00000100:00100000:1.0:1783966934.668667:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563718400 00000100:00100000:1.0:1783966934.668752:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:1.0:1783966934.668765:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:11371:x1870624563718400:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1783966934.668952:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.668977:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.668991:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669005:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669012:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669018:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669120:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669129:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669136:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966934.669197:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669213:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669230:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669237:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669243:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.669248:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669256:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669270:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966934.669273:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966934.669279:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669286:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160675fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669301:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669307:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669313:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669318:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.669327:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669334:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669342:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:1.0:1783966934.669345:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966934.669348:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669354:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067603 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669364:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669370:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669376:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669381:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ee00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966934.669383:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669389:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669396:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966934.669398:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966934.669407:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.669414:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606760a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966934.669511:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:11371:x1870624563718400:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 746us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.669520:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 112 00000100:00100000:3.0:1783966934.719201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.719494:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563718656 00000100:00100000:0.0:1783966934.719509:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563718656 00000100:00100000:0.0:1783966934.719599:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:0.0:1783966934.719612:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:11374:x1870624563718656:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966934.719899:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966934.719930:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067611 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d5f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720030:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720385:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720403:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720420:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720428:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720435:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720597:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720691:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720700:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966934.720714:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783966934.720937:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720945:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720952:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720959:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966934.720964:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720972:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.720986:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966934.720989:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966934.720994:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067618 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721016:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721028:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721033:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721038:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966934.721041:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721189:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721198:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:0.0:1783966934.721201:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966934.721204:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721212:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606761f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721266:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067611 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721281:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.721289:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966934.721292:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966934.721301:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783966934.721399:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11374:x1870624563718656:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1787us (2211us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783966934.721410:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:3.0:1783966934.730365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.730473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563718784 00000100:00100000:2.0:1783966934.730486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563718784 00000100:00100000:2.0:1783966934.730573:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:2.0:1783966934.730586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11374:x1870624563718784:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:2.0:1783966934.730683:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730706:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730721:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730808:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730816:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730823:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730852:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.730857:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730865:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730880:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:2.0:1783966934.730883:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783966934.730898:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.730906:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316067634 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.731000:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11374:x1870624563718784:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 416us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.731009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:3.0:1783966934.732598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.732687:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719040 00000100:00100000:1.0:1783966934.732699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719040 00000100:00100000:1.0:1783966934.732761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1783966934.732813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:11374:x1870624563719040:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966934.733119:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11374:x1870624563719040:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 348us (528us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1783966934.733127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783966934.837219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.837305:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719296 00000100:00100000:2.0:1783966934.837318:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719296 00000100:00100000:2.0:1783966934.837464:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:2.0:1783966934.837477:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11384:x1870624563719296:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966934.837514:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.837518:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783966934.837559:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b3160675b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d43 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837585:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.837610:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966934.837629:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606763b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d66 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837836:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837865:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837876:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837927:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.837943:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 54 pid: 6519 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.837959:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587909632:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966934.838088:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9180 going to sleep for 11 seconds 00000100:00100000:3.0:1783966934.843246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.843346:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719424 00000100:00100000:0.0:1783966934.843360:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719424 00010000:00010000:0.0:1783966934.843420:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 55 pid: 6519 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966934.843475:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:0.0:1783966934.843487:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:2401:x1870624563719424:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966934.843506:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966934.843514:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 55 pid: 6519 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.843528:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 55 pid: 6519 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.843558:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966934.843564:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.843576:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.843584:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.843611:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966934.843712:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:2401:x1870624563719424:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 227us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.843720:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00010000:00010000:2.0:1783966934.850856:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067626 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d5f expref: 54 pid: 6519 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.850900:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587909632:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966934.850937:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.850950:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.850984:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.851015:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783966934.851212:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606763b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 55 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.851231:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 54 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.851242:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:2.0:1783966934.851247:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783966934.851251:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:2.0:1783966934.851356:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11384:x1870624563719296:12345-192.168.204.59@tcp:101:bash.0 Request processed in 13881us (14153us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1783966934.851367:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 115 00000100:00100000:3.0:1783966934.856195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.856350:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719552 00000100:00100000:0.0:1783966934.856365:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719552 00000100:00100000:0.0:1783966934.856448:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:0.0:1783966934.856462:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:11384:x1870624563719552:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966934.856495:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966934.856526:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067650 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d6d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856574:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856593:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856610:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856804:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067650 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856826:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.856838:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966934.856841:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966934.856845:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0c00, rc 0) 00000100:00100000:0.0:1783966934.856953:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:11384:x1870624563719552:12345-192.168.204.59@tcp:101:bash.0 Request processed in 492us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.856961:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 116 00000100:00100000:1.0:1783966934.863950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.864723:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719808 00000100:00100000:2.0:1783966934.864740:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719808 00000100:00100000:2.0:1783966934.864926:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 117 00000100:00100000:2.0:1783966934.864939:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:11384:x1870624563719808:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:2.0:1783966934.865645:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.865674:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.865691:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783966934.865805:0:10203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1783966934.865836:0:10203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003611c7dd reply state 00000000f041c520 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.865851:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.865860:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:2.0:1783966934.865864:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966934.865869:0:10203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966934.866090:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11384:x1870624563719808:12345-192.168.204.59@tcp:36:bash.0 Request processed in 1151us (2153us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1783966934.866099:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 117 00000020:00080000:2.0:1783966934.866105:0:10203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783966934.869424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.869546:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563719936 00000100:00100000:2.0:1783966934.869559:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563719936 00000100:00100000:2.0:1783966934.869696:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:2.0:1783966934.869709:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11384:x1870624563719936:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966934.869743:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.869811:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067665 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d74 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.869978:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.869997:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 59 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.870019:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.870080:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 59 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.870095:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 59 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.870113:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587909760:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966934.870224:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966934.873663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.873953:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cac700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587909760:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966934.873992:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966934.874181:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720064 00000100:00100000:3.0:1783966934.874192:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720064 00010000:00010000:3.0:1783966934.874243:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 60 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966934.874344:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:3.0:1783966934.874357:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:2401:x1870624563720064:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966934.874376:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966934.874385:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 60 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874416:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 60 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874446:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067642 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d66 expref: 60 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874466:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966934.874472:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874484:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874494:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.874529:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966934.874613:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:2401:x1870624563720064:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 258us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.874622:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00010000:00010000:1.0:1783966934.874675:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.874683:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966934.874754:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783966934.874760:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966934.874845:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.874884:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067665 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 59 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.874910:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 58 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.874919:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966934.874922:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966934.874925:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:1.0:1783966934.874954:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11384:x1870624563719936:12345-192.168.204.59@tcp:101:bash.0 Request processed in 5248us (5545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.874961:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:1.0:1783966934.880524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.880723:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720320 00000100:00100000:2.0:1783966934.880737:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720320 00000100:00100000:2.0:1783966934.881051:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1783966934.881202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:11384:x1870624563720320:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1783966934.881567:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11384:x1870624563720320:12345-192.168.204.59@tcp:35:bash.0 Request processed in 503us (1060us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783966934.881577:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:3.0:1783966934.903906:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587910016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966934.904010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966934.904062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587909888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966934.904086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966934.904155:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910016 00000100:00100000:0.0:1783966934.904166:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910016 00000100:00100000:0.0:1783966934.904227:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587909888 00000100:00100000:0.0:1783966934.904230:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587909888 00000100:00100000:3.0:1783966934.904258:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783966934.904271:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587910016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966934.904322:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966934.904334:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587910144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966934.904366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966934.904370:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587910016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.904426:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587910016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783966934.904653:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783966934.904666:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587910272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966934.904699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966934.904734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910144 00000100:00100000:1.0:1783966934.904738:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910144 00000100:00080000:2.0:1783966934.904822:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966934.905506:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587910400:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.905570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.905612:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587910912:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.905638:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.905662:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587911424:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.905687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.905709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783966934.905715:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587910784:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.905735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.905756:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587911296:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.905826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.906143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910912 00000100:00100000:2.0:1783966934.906151:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910912 00000100:00100000:2.0:1783966934.906203:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783966934.906213:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587910912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906362:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587910912:12345-0@lo:400:kworker.0 Request processed in 149us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.906370:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783966934.906412:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587910656:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.906462:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587911168:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.906505:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783966934.906512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587910528:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.906553:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587911040:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966934.906610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910656 00000100:00100000:2.0:1783966934.906613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910656 00000100:00100000:2.0:1783966934.906634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783966934.906640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587910656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906675:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587910656:12345-0@lo:400:kworker.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.906682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783966934.906716:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587910656:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906757:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587910912:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.906816:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587911424 00000100:00100000:2.0:1783966934.906820:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587911424 00000100:00100000:0.0:1783966934.907138:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910272 00000100:00100000:0.0:1783966934.907144:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910272 00000100:00100000:0.0:1783966934.907173:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783966934.907183:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587909888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966934.907204:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966934.907251:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587909888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.907258:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783966934.907346:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910784 00000100:00100000:2.0:1783966934.907351:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910784 00000100:00100000:2.0:1783966934.907369:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587911296 00000100:00100000:2.0:1783966934.907372:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587911296 00000100:00100000:2.0:1783966934.907386:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587911168 00000100:00100000:2.0:1783966934.907389:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587911168 00000100:00100000:2.0:1783966934.907401:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910528 00000100:00100000:2.0:1783966934.907403:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910528 00000100:00100000:2.0:1783966934.907435:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587911040 00000100:00100000:2.0:1783966934.907437:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587911040 00000100:00100000:2.0:1783966934.907450:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783966934.907455:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587911424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907495:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587911424:12345-0@lo:400:kworker.0 Request processed in 40us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907501:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1783966934.907513:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783966934.907525:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907552:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587910784:12345-0@lo:400:kworker.0 Request processed in 27us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907558:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1783966934.907571:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783966934.907577:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587911296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907605:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587911296:12345-0@lo:400:kworker.0 Request processed in 28us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907610:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1783966934.907621:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783966934.907626:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587911168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907656:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587911168:12345-0@lo:400:kworker.0 Request processed in 30us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907663:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783966934.907673:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783966934.907679:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587910528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907706:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587910528:12345-0@lo:400:kworker.0 Request processed in 27us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907711:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783966934.907722:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783966934.907728:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587911040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907752:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587911040:12345-0@lo:400:kworker.0 Request processed in 25us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.907758:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1783966934.907807:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966934.907820:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966934.907822:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966934.907877:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587909888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966934.907922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587910528:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.907934:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587911040:0@lo:400:kworker.0 00010000:00080000:2.0:1783966934.907946:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fd0a80 x1870624587911168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966934.908193:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587911168:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.908234:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587910784:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.908246:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587911296:0@lo:400:kworker.0 00010000:00080000:2.0:1783966934.908395:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fd2a00 x1870624587911424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966934.908409:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587911424:0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.908476:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587910400 00000100:00100000:2.0:1783966934.908483:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587910400 00000100:00100000:2.0:1783966934.908524:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1783966934.908532:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587910400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966934.908584:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587910400:12345-0@lo:400:kworker.0 Request processed in 53us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.908591:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1783966934.908631:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587910400:0@lo:400:kworker.0 00000100:00100000:0.0:1783966934.909112:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783966934.909123:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587910272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966934.909146:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966934.909208:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587910272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.909215:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783966934.909384:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587910272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966934.910407:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783966934.910457:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783966934.910475:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1870624587910144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783966934.910498:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966934.910570:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1870624587910144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (6204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.910577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783966934.910628:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587910144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966934.936414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966934.937056:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720448 00000100:00100000:0.0:1783966934.937069:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720448 00000100:00100000:0.0:1783966934.937152:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:0.0:1783966934.937165:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:11390:x1870624563720448:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966934.937198:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966934.937227:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d7b expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937337:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937356:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937371:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966934.937433:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783966934.937437:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966934.937461:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937490:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316067673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d7b expref: 61 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937511:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d7b expref: 60 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.937521:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:0.0:1783966934.937524:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783966934.937529:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0000, rc 0) 00000100:00100000:0.0:1783966934.937669:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563720448:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 506us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966934.937676:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:3.0:1783966934.944765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.944981:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720576 00000100:00100000:2.0:1783966934.944994:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720576 00000100:00100000:2.0:1783966934.945136:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:2.0:1783966934.945149:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563720576:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966934.945186:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.945220:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067681 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d82 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945323:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945341:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945355:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945366:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945374:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945381:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945484:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945493:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945522:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.945583:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783966934.945588:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966934.945613:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945628:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945649:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945657:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945665:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945671:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.945678:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945687:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945701:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966934.945704:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.945710:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945726:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067688 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945743:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945749:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945755:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945760:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966934.945764:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945833:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.945842:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:2.0:1783966934.945845:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966934.946976:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.946993:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b31606768f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.947048:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067681 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d82 expref: 62 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.947064:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d82 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.947088:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:2.0:1783966934.947092:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966934.947095:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783966934.947198:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11390:x1870624563720576:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2050us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966934.947208:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:1.0:1783966934.953440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966934.953521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.953589:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720960 00000100:00100000:3.0:1783966934.953602:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720960 00000100:00100000:3.0:1783966934.953683:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1783966934.953695:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:2401:x1870624563720960:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966934.953715:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966934.953747:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d82 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.953955:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966934.953961:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966934.954022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:2401:x1870624563720960:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 329us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.954030:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1783966934.956112:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563720832 00000100:00100000:2.0:1783966934.956130:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563720832 00000100:00100000:2.0:1783966934.956220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:2.0:1783966934.956233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563720832:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966934.956261:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966934.956288:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606769d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d89 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.956457:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.956478:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.956672:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.957072:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.957091:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 61 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966934.957130:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587911552:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966934.957292:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966934.959676:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587911552:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966934.959712:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966934.966962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.967105:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721088 00000100:00100000:3.0:1783966934.967119:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721088 00010000:00010000:3.0:1783966934.967178:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 62 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966934.967232:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1783966934.967243:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:2400:x1870624563721088:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966934.967263:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966934.967293:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 62 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967320:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 62 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967350:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606766c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d74 expref: 62 pid: 7847 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967369:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966934.967374:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967387:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967397:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.967494:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966934.967569:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:2400:x1870624563721088:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 327us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.967578:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00010000:00010000:2.0:1783966934.968684:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966934.968700:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966934.968726:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783966934.969154:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606769d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.969195:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966934.969204:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966934.969207:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783966934.969209:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630600, rc 0) 00000100:00100000:0.0:1783966934.969757:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11390:x1870624563720832:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 13521us (16326us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783966934.969798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:0.0:1783966934.973948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.974137:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721344 00000100:00100000:3.0:1783966934.974151:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721344 00000100:00100000:3.0:1783966934.974237:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1783966934.974249:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11390:x1870624563721344:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:3.0:1783966934.974303:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966934.974355:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160675f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d58 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.974384:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966934.974391:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966934.974641:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563721344:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 393us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.974651:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1783966934.983129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966934.983292:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721472 00000100:00100000:2.0:1783966934.983306:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721472 00000100:00100000:1.0:1783966934.983553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:1.0:1783966934.983569:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563721472:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:1.0:1783966934.986155:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.986186:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966934.986205:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783966934.986367:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1783966934.987070:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563721472:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 3496us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966934.987083:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:1.0:1783966934.991142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966934.991240:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721600 00000100:00100000:3.0:1783966934.991253:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721600 00000100:00100000:3.0:1783966934.991334:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:3.0:1783966934.991346:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:11390:x1870624563721600:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966934.991373:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966934.991400:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d90 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991489:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991504:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991527:0:7847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991542:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991558:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966934.991581:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783966934.991586:0:7847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 61 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966934.991595:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1000, rc 0) 00000100:00100000:3.0:1783966934.991676:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11390:x1870624563721600:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 332us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966934.991684:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00010000:00010000:3.0:1783966935.098177:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966935.415690:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587911680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966935.415852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966935.416228:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587911680 00000100:00100000:0.0:1783966935.416241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587911680 00000100:00100000:0.0:1783966935.416341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783966935.416353:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587911680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783966935.416408:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783966935.417128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587911680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 773us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.417139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783966935.420969:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587911680:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783966935.543946:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966935.543972:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966935.544006:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783966935.544021:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966935.544208:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587911808:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783966935.544362:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783966935.552029:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.552186:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721728 00000100:00100000:0.0:1783966935.552197:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721728 00000100:00100000:2.0:1783966935.552411:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587911808:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783966935.553672:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:0.0:1783966935.553696:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11391:x1870624563721728:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783966935.553745:0:6519:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783966935.553969:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11391:x1870624563721728:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 283us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.553985:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:0.0:1783966935.568362:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.568526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563721856 00000100:00100000:1.0:1783966935.568538:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563721856 00000100:00100000:1.0:1783966935.568624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:1.0:1783966935.568637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11391:x1870624563721856:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783966935.568739:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568761:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568827:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568849:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568856:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568863:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568906:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568916:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.568923:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966935.568995:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783966935.569001:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966935.569020:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569033:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569041:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569058:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569065:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ec00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966935.569070:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569078:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569094:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:1.0:1783966935.569097:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966935.569102:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569109:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b3160676c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569124:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569130:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569136:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569141:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966935.569144:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569159:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569168:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9a05f5465500) 00010000:00010000:1.0:1783966935.569171:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966935.569173:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569179:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160676c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569194:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569200:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569206:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569211:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966935.569214:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569220:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569226:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966935.569228:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966935.569231:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.569245:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b3160676ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.569345:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11391:x1870624563721856:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 710us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.569354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:1.0:1783966935.582847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.582953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563722112 00000100:00100000:0.0:1783966935.582967:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563722112 00000100:00100000:0.0:1783966935.583047:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1783966935.583060:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+61:11391:x1870624563722112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966935.583089:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966935.583116:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160676d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d97 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583276:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583296:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583310:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966935.583325:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783966935.583507:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583516:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583524:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583532:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.583568:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583576:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583592:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966935.583596:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783966935.583602:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583610:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160676dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583669:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160676d5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d97 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583682:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:0.0:1783966935.583684:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966935.583688:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160676d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d97 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.583698:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1e00, rc 0) 00000100:00100000:0.0:1783966935.583965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722112:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 905us (1132us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1783966935.583974:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:0.0:1783966935.592327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.592599:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563722240 00000100:00100000:2.0:1783966935.592614:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563722240 00000100:00100000:2.0:1783966935.592699:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1783966935.592712:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722240:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783966935.592765:0:6519:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783966935.592979:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722240:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 268us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966935.592988:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:1.0:1783966935.599502:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.599677:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563722496 00000100:00100000:2.0:1783966935.599690:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563722496 00000100:00100000:2.0:1783966935.599797:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1783966935.599809:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.599838:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966935.599843:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783966935.599894:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b31606767a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d7b expref: 62 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.599918:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966935.599925:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966935.599942:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160676ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6d9e expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783966935.601551:0:7847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783966935.601824:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b3160676f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.601845:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b3160676f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.601892:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b3160676f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.602006:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160676ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d9e expref: 64 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.602035:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b3160676f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d9e expref: 63 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.602046:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a04c1ccaa00) 00010000:00010000:2.0:1783966935.602049:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966935.602054:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783966935.602171:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11391:x1870624563722496:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 2362us (2681us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783966935.602182:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:0.0:1783966935.608469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.608638:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563722752 00000100:00100000:2.0:1783966935.608653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563722752 00000100:00100000:2.0:1783966935.608721:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1783966935.608733:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11391:x1870624563722752:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.608846:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966935.608895:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b3160676f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d9e expref: 63 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.608917:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a04c1ccaa00) 00010000:00010000:2.0:1783966935.608930:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966935.608959:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.608993:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609005:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609027:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609033:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609095:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609101:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609109:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609115:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966935.609120:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609129:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609137:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:2.0:1783966935.609145:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966935.609150:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609155:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b3160676ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609166:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609171:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609177:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609183:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966935.609186:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609192:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609199:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xed269aec (ffff9a04c1ccad00) 00010000:00010000:2.0:1783966935.609201:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966935.609203:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.609209:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067706 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xed269aec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.609539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722752:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 805us (1086us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783966935.609553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:0.0:1783966935.622850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.623247:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563722880 00000100:00100000:1.0:1783966935.623263:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563722880 00000100:00100000:1.0:1783966935.623415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:1.0:1783966935.623430:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+62:11391:x1870624563722880:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966935.623459:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966935.623493:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606770d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6da5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623549:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623566:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623581:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623760:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606770d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623852:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.623863:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:1.0:1783966935.623867:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966935.623884:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966935.624480:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11391:x1870624563722880:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1051us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.624490:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:0.0:1783966935.632980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.636935:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563723136 00000100:00100000:2.0:1783966935.636961:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563723136 00000100:00100000:2.0:1783966935.637050:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:2.0:1783966935.637063:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:11391:x1870624563723136:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.637178:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.637202:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.637218:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783966935.637927:0:7847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783966935.637944:0:7847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411839173271ns, next at 412839169131ns, rc = 0 00000004:00010000:2.0:1783966935.638013:0:7847:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e73b177b reply state 00000000ad2593b3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.638029:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.638037:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.638040:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783966935.638045:0:7847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966935.638237:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:11391:x1870624563723136:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1174us (5273us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783966935.638245:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:0.0:1783966935.646726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.646963:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563723264 00000100:00100000:2.0:1783966935.647001:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563723264 00000100:00100000:2.0:1783966935.647086:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:2.0:1783966935.647099:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:11391:x1870624563723264:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.647135:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966935.647167:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.647254:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.647273:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.647299:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.647303:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783966935.647307:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630200, rc 0) 00000100:00100000:2.0:1783966935.647391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:11391:x1870624563723264:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 295us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966935.647399:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:0.0:1783966935.658089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966935.658196:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563723392 00000100:00100000:3.0:1783966935.658210:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563723392 00000100:00100000:3.0:1783966935.658298:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:3.0:1783966935.658310:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563723392:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783966935.658607:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966935.659060:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563723392:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 749us (982us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783966935.659070:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1783966935.671159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.674439:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563723648 00000100:00100000:1.0:1783966935.674462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563723648 00000100:00100000:1.0:1783966935.674571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1783966935.674586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:11391:x1870624563723648:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783966935.674930:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:11391:x1870624563723648:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 348us (3787us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1783966935.674939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:0.0:1783966935.679539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.679666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563723904 00000100:00100000:1.0:1783966935.679682:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563723904 00000100:00100000:1.0:1783966935.679866:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:1.0:1783966935.679892:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:11391:x1870624563723904:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783966935.680052:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:11391:x1870624563723904:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 164us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.680060:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1783966935.684977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.685172:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724032 00000100:00100000:2.0:1783966935.685186:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724032 00000100:00100000:2.0:1783966935.685280:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:2.0:1783966935.685295:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:11391:x1870624563724032:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.685347:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966935.685379:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067729 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6db3 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.685677:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.685697:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.685713:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966935.685973:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966935.686000:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.686095:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6db3 expref: 69 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.686121:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6db3 expref: 68 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.686131:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.686134:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783966935.686138:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783966935.686280:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:11391:x1870624563724032:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 989us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966935.686290:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:2.0:1783966935.691428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.691519:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724160 00000100:00100000:1.0:1783966935.691558:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724160 00000100:00100000:1.0:1783966935.691638:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1783966935.691650:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563724160:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966935.691675:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966935.691701:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dba expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783966935.691733:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552cd7, blocks: 0x0 00010000:00010000:1.0:1783966935.692053:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1783966935.692060:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966935.692073:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.692096:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.692111:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ec00, rc 0) 00000100:00100000:1.0:1783966935.692193:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2401:x1870624563724160:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 544us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.692202:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:0.0:1783966935.708007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966935.708470:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724416 00000100:00100000:3.0:1783966935.708486:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724416 00000100:00100000:3.0:1783966935.708587:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:3.0:1783966935.708601:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:11391:x1870624563724416:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783966935.708823:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:11391:x1870624563724416:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 167us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966935.708832:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:2.0:1783966935.712517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.712644:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724544 00000100:00100000:0.0:1783966935.712658:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724544 00000100:00100000:0.0:1783966935.712727:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1783966935.712738:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:11391:x1870624563724544:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966935.712822:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966935.712849:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dc1 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.712908:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.712920:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966935.712925:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966935.712932:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.712980:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.712997:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 11 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.713038:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1870624587911936:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966935.713185:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001000 going to sleep for 11 seconds 00000100:00100000:2.0:1783966935.717335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966935.717609:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724672 00000100:00100000:3.0:1783966935.717621:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724672 00010000:00010000:3.0:1783966935.717689:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 12 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.717750:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:3.0:1783966935.717761:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:2400:x1870624563724672:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966935.717837:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966935.717868:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 12 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.717936:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 12 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.717971:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966935.717976:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966935.717987:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.717998:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.718052:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.718071:0:6503:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1870624587912064:192.168.204.59@tcp:105: 00000100:00100000:3.0:1783966935.718172:0:6503:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966935.721434:0:6503:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6503:1870624587912064:192.168.204.59@tcp:105: 00010000:00010000:3.0:1783966935.721477:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966935.722149:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:2400:x1870624563724672:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 4385us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966935.722164:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00010000:00010000:0.0:1783966935.722368:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff39c3a9/0x9269c8b316067737 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dba expref: 11 pid: 8432 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.722391:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1870624587911936:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966935.722434:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.722452:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1000, rc 0) 00000100:00100000:0.0:1783966935.722490:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:11391:x1870624563724544:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 9754us (9988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.722498:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:2.0:1783966935.726765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.727318:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724800 00000100:00100000:0.0:1783966935.727333:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724800 00002000:00100000:0.0:1783966935.727411:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a04c3fd3800 x1870624563724800/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:96/0 lens 504/0 e 0 to 0 dl 1783966946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783966935.727427:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3fd3800 with x1870624563724800 ext(0->12) 00002000:00010000:0.0:1783966935.727435:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3fd3800 00000100:00100000:0.0:1783966935.727524:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1783966935.727545:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2401:x1870624563724800:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783966935.729150:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:2401:x1870624563724800:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 1602us (2398us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783966935.729180:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:0.0:1783966935.729195:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a04c3fd3800 x1870624563724800/t4294967309(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:96/0 lens 504/448 e 0 to 0 dl 1783966946 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783966935.729205:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3fd3800 with x1870624563724800 ext(0->12) 00002000:00010000:0.0:1783966935.729213:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3fd3800 00000100:00100000:2.0:1783966935.736908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.737056:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563724928 00000100:00100000:1.0:1783966935.737071:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563724928 00000100:00100000:1.0:1783966935.737157:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:1.0:1783966935.737170:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:11391:x1870624563724928:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783966935.740989:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1783966935.741022:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783966935.741096:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783966935.741133:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05f4f89900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783966935.741140:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a04c2731f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05f4f89600 00000020:00080000:1.0:1783966935.741145:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a04c2731a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c300d400 00000004:00080000:1.0:1783966935.741189:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783966935.741213:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05c7d5fb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783966935.741216:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f4ef1400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c516e780 00000020:00080000:1.0:1783966935.741219:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f4ef1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c3c7da00 00000020:00080000:1.0:1783966935.741230:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1783966935.741254:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1783966935.741350:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1783966935.741553:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11391:x1870624563724928:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 4367us (4642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.741566:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:2.0:1783966935.742052:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587912320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783966935.742142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966935.742237:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966935.742247:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587912192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783966935.742302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966935.742337:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587912320 00000100:00100000:2.0:1783966935.742346:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587912320 00000100:00100000:2.0:1783966935.742410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587912192 00000100:00100000:2.0:1783966935.742413:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587912192 00000100:00100000:2.0:1783966935.742436:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783966935.742445:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1870624587912320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783966935.742635:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783966935.742639:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783966935 00002000:00010000:2.0:1783966935.742642:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783966935.742644:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783966935 -> 1783966935 00002000:00010000:2.0:1783966935.742646:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783966935.742687:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1870624587912320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (545us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783966935.742696:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783966935.742713:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783966935.742721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1870624587912192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783966935.742737:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1783966935.742834:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.742867:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.742892:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783966935.742897:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966935.742904:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.742943:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.742961:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 11 pid: 8434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.742978:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1870624587912448:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966935.743046:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1783966935.743067:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783966935.743115:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3fd2300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783966935.743123:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587912320:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1783966935.746596:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746625:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746635:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746643:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.746649:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746802:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746828:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:0.0:1783966935.746831:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.746838:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746845:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067443 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746902:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746941:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746948:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746954:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.746957:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746964:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746975:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966935.746977:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.746981:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.746988:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160674eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747192:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747200:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747207:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747217:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.747228:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747234:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747244:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:0.0:1783966935.747247:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.747250:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747256:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067569 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.747462:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783966935.747485:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587912576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783966935.747536:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1870624587912448:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966935.747570:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747888:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747897:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747905:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747911:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.747915:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747923:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747934:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a05f5465b00) 00010000:00010000:0.0:1783966935.747937:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.747950:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747958:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606758c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747979:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747987:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747993:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.747998:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.748011:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748017:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748097:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966935.748099:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.748103:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748109:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b31606765e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748123:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748129:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748143:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748148:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.748151:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748158:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748167:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:0.0:1783966935.748169:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783966935.748172:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.748180:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606771b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.748976:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.749204:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725056 00000100:00100000:0.0:1783966935.749215:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725056 00010000:00010000:0.0:1783966935.749333:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 12 pid: 8434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.749438:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:0.0:1783966935.749450:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:2400:x1870624563725056:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966935.749955:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966935.749967:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 12 pid: 8434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.750128:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 12 pid: 8434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.750164:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b3160674f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d19 expref: 12 pid: 8434 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.750184:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966935.750189:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966935.750196:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.750207:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.750247:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966935.750369:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.750380:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.750404:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.750413:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.750445:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783966935.750761:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966935.750787:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.750796:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783966935.750808:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.750818:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.750833:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.750841:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316067745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.750864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966935.750866:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966935.750868:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966935.751014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966935.751336:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2400:x1870624563725056:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1548us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.751350:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:2.0:1783966935.751621:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587912576 00000100:00100000:2.0:1783966935.751632:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587912576 00000100:00100000:2.0:1783966935.751820:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783966935.751831:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1870624587912576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783966935.751887:0:8714:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1783966935.751936:0:8714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a552cd5, atime: 0x6a552cd5, ctime: 0x6a552cd5, blocks: 0x8 00010000:00010000:2.0:1783966935.751944:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.751961:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1783966935.751965:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966935.751972:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.752015:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783966935.752312:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966935.752420:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.752868:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1783966935.752892:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783966935.753134:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3645:x1870624587912192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10411us (10827us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783966935.753145:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783966935.753174:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725184 00000100:00100000:1.0:1783966935.753182:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725184 00000100:00100000:1.0:1783966935.753220:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:1.0:1783966935.753228:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2400:x1870624563725184:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.753397:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.753408:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.753431:0:8714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783966935.753962:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3fd1180/2, rc 0, transno 4294967311 00000100:00100000:0.0:1783966935.753972:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587912192:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1783966935.754809:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966935.754822:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.754836:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966935.754842:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.754853:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.754895:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.754904:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d27d996/0x9269c8b31606774c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.754923:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3647:x1870624587912576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3091us (3908us total) trans 4294967305 rc 0/0 00010000:00010000:3.0:1783966935.754933:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966935.754935:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1783966935.754937:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966935.754941:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783966935.755510:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3ea5500/2, rc 0, transno 4294967305 00000100:00100000:1.0:1783966935.755519:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587912576:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1783966935.764405:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1783966935.764425:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1783966935.764658:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563725184:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 11423us (12232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.764671:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1783966935.768507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.776374:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725440 00000100:00100000:2.0:1783966935.776393:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725440 00000100:00100000:2.0:1783966935.776538:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:2.0:1783966935.776550:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11391:x1870624563725440:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.776609:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966935.776641:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6db3 expref: 16 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.776662:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.776667:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966935.776696:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.776739:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.776751:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966935.776944:0:7847:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005207b906 reply state 00000000ee7a3107 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.776959:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.776966:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.776969:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966935.776971:0:7847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966935.777105:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:11391:x1870624563725440:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 556us (8607us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1783966935.777112:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:0.0:1783966935.781583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.781719:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725568 00000100:00100000:1.0:1783966935.781731:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725568 00000100:00100000:1.0:1783966935.781818:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783966935.781829:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563725568:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783966935.782014:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783966935.782025:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783966935 -> 1783966934 00002000:00010000:1.0:1783966935.782027:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783966933 00002000:00010000:1.0:1783966935.782029:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783966935 -> 1783966934 00002000:00010000:1.0:1783966935.782032:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783966935.782101:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563725568:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 274us (528us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783966935.782109:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783966935.800065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.807190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725824 00000100:00100000:0.0:1783966935.807211:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725824 00000100:00100000:1.0:1783966935.813032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:1.0:1783966935.813050:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:11391:x1870624563725824:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783966935.813161:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.813180:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.813190:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.813229:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.813245:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 17 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.813260:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587912704:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966935.813943:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47600 going to sleep for 11 seconds 00000100:00100000:1.0:1783966935.824809:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587912704:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966935.824846:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.827955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.828215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563725952 00000100:00100000:0.0:1783966935.828225:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563725952 00010000:00010000:0.0:1783966935.828270:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 18 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.828530:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:0.0:1783966935.828542:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2400:x1870624563725952:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966935.828559:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966935.828567:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 18 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828581:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 18 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828608:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067714 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6da5 expref: 18 pid: 6518 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828625:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:0.0:1783966935.828630:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828641:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828649:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.828689:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966935.828766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:2400:x1870624563725952:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 224us (818us total) trans 0 rc 0/0 00010000:00010000:2.0:1783966935.828810:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828823:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.828825:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00010000:00010000:2.0:1783966935.828889:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828897:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828905:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828919:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ee00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966935.828924:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828932:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828942:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966935.828945:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783966935.828949:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.828957:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b31606775a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.829005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11391:x1870624563725824:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 15958us (28951us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783966935.829015:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:3.0:1783966935.831765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.832086:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726080 00000100:00100000:2.0:1783966935.832100:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726080 00000100:00100000:2.0:1783966935.832465:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1783966935.832479:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563726080:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783966935.832542:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.832572:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.832607:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783966935.832612:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966935.832618:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.832672:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.832750:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 7 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.832897:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1870624587912832:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966935.833065:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966935.836606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.836821:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726208 00000100:00100000:2.0:1783966935.836833:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1870624587912832:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966935.836840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726208 00010000:00010000:2.0:1783966935.836886:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.836914:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 8 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.836960:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1783966935.836970:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563726208:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966935.836988:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966935.837010:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 8 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.837024:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 8 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.837055:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b31606773e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc1 expref: 8 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.837077:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966935.837081:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966935.837088:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.837099:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.837292:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966935.837376:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563726208:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 407us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.837385:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00010000:00010000:2.0:1783966935.846445:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846466:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846503:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846532:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846540:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846549:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783966935.846553:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846562:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846582:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.846590:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316067761 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.846728:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563726080:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 14247us (14972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966935.846738:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:3.0:1783966935.850220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.850335:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726464 00000100:00100000:1.0:1783966935.850352:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726464 00000100:00100000:1.0:1783966935.850438:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:1.0:1783966935.850448:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:11391:x1870624563726464:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783966935.850541:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.850558:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.850569:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.850608:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.850622:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 16 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.850638:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587912960:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966935.850749:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47600 going to sleep for 11 seconds 00000100:00100000:2.0:1783966935.860173:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587912960:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966935.860211:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.869426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966935.869689:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726592 00000100:00100000:3.0:1783966935.869707:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726592 00010000:00010000:3.0:1783966935.869824:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 17 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.871202:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:3.0:1783966935.871231:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:2400:x1870624563726592:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966935.871261:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966935.871277:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 17 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871298:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 17 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871330:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067657 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d6d expref: 17 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871356:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966935.871363:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 16 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871376:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871385:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871394:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.871445:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966935.873267:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:2400:x1870624563726592:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 2035us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966935.873286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00010000:00010000:1.0:1783966935.876477:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.876595:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.877738:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.877767:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.877792:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.877844:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.877863:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 16 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.877895:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587913088:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966935.878007:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783966935.887882:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587913088:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966935.887915:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.889084:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966935.889454:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726720 00000100:00100000:1.0:1783966935.889466:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726720 00010000:00010000:1.0:1783966935.889542:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 17 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.889617:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:1.0:1783966935.889628:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:2400:x1870624563726720:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966935.889644:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966935.889652:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 17 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889666:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 17 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889690:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dac expref: 17 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889707:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:1.0:1783966935.889713:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889724:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889732:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.889826:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966935.889841:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.889853:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.889902:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:2400:x1870624563726720:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 274us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.889911:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000001:00080000:0.0:1783966935.890015:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1783966935.890168:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1783966935.890205:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1783966935.890307:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587913216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783966935.890359:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966935.890393:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966935.890698:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587913216 00000100:00100000:1.0:1783966935.890738:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587913216 00000100:00100000:1.0:1783966935.890809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783966935.890818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1870624587913216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783966935.890914:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1870624587913216:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.890922:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783966935.891027:0:6518:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1783966935.891035:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1783966935.891060:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3fd2300, transno 4294967310 00000004:00080000:0.0:1783966935.891076:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3fd1180, transno 4294967311 00000100:00100000:0.0:1783966935.891084:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587913216:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783966935.891222:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1783966935.891292:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587913344:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783966935.891324:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966935.891352:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966935.891419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587913344 00000100:00100000:3.0:1783966935.891425:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587913344 00000100:00100000:3.0:1783966935.891463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783966935.891472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1870624587913344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783966935.891613:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1870624587913344:12345-0@lo:1000:mdt00_001.0 Request processed in 142us (288us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783966935.891622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783966935.891656:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587913344:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783966935.891690:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891700:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891708:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891714:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966935.891719:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891727:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891767:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:3.0:1783966935.891788:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783966935.891794:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891802:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606776f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891827:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891834:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891840:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891846:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966935.891849:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891855:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891863:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:3.0:1783966935.891865:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783966935.891881:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891893:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891908:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.891934:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966935.891946:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587913472:192.168.204.59@tcp:105: 00000100:00100000:3.0:1783966935.892015:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea33c900 going to sleep for 11 seconds 00000100:00100000:3.0:1783966935.899202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.899315:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587913472:192.168.204.59@tcp:105: 00010000:00010000:0.0:1783966935.899358:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899369:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160676b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899406:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899420:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899432:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899443:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899450:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899457:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899463:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.899466:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899474:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899484:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966935.899487:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966935.899514:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899521:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067776 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899539:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899545:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899551:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899556:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ec00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966935.899558:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899563:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899571:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966935.899573:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966935.899575:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.899580:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067768 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.899808:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11391:x1870624563726464:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 49360us (49606us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1783966935.899819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000020:00080000:0.0:1783966935.899832:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783966935.900171:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966935.900177:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966935.900683:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783966935.900707:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783966935.901806:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563726848 00000100:00100000:1.0:1783966935.901818:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563726848 00000100:00100000:1.0:1783966935.901889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1783966935.901899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11390:x1870624563726848:12345-192.168.204.59@tcp:49:lfs.0 00000100:00100000:1.0:1783966935.902029:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11390:x1870624563726848:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 131us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.902036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783966935.908240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966935.908292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.908363:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563727104 00000100:00100000:2.0:1783966935.908373:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563727104 00000100:00100000:2.0:1783966935.908441:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:2.0:1783966935.908451:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11390:x1870624563727104:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:2.0:1783966935.908660:0:7847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783966935.908741:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11390:x1870624563727104:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 291us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966935.908749:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:1.0:1783966935.909467:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563727360 00000100:00100000:1.0:1783966935.909474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563727360 00000100:00100000:1.0:1783966935.909508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1783966935.909516:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:11391:x1870624563727360:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783966935.909829:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783966935.909866:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1783966935.909911:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.909930:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.909948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.909975:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.909982:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.909989:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.910013:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783966935.910081:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:11391:x1870624563727360:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 564us (1786us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783966935.910088:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000020:00080000:1.0:1783966935.910092:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783966935.910303:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966935.910309:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.910317:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966935.910321:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.910327:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.910341:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:3.0:1783966935.910344:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783966935.910348:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.910354:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b31606777d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966935.910374:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966935.910376:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966935.910378:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966935.966651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.966820:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563727488 00000100:00100000:2.0:1783966935.966830:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563727488 00000100:00100000:2.0:1783966935.966918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:2.0:1783966935.966929:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:11393:x1870624563727488:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966935.966957:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966935.966980:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067784 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dc8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967056:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967073:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967086:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967121:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967129:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.967136:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.968924:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.968952:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.968962:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.969011:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966935.969028:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 22 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966935.969043:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587913600:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966935.969162:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966935.978443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966935.979594:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587913600:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966935.979626:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966935.980253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563727744 00000100:00100000:1.0:1783966935.980262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563727744 00000100:00100000:1.0:1783966935.980343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783966935.980353:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:6639:x1870624563727744:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783966935.980629:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:6639:x1870624563727744:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 276us (2194us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1783966935.980637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783966935.989067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966935.989181:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563727872 00000100:00100000:0.0:1783966935.989191:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563727872 00010000:00010000:0.0:1783966935.989233:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 24 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966935.989280:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1783966935.989290:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:2401:x1870624563727872:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966935.989307:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966935.989315:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 24 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989328:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 24 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989352:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b3160676a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d89 expref: 24 pid: 6519 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989368:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966935.989374:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989384:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989392:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966935.989434:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966935.989515:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:2401:x1870624563727872:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 225us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966935.989523:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00010000:00010000:1.0:1783966935.990092:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990101:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966935.990162:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783966935.990166:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966935.990186:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990201:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990211:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990217:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990223:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990228:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966935.990232:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990239:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990250:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966935.990253:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966935.990257:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990262:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606778b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990286:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990292:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990298:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990303:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966935.990306:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990312:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990320:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a04c1cca200) 00010000:00010000:1.0:1783966935.990322:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966935.990325:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990337:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067792 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990373:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067784 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990388:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc8 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966935.990408:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966935.990410:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966935.990412:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630200, rc 0) 00000100:00100000:1.0:1783966935.990457:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11393:x1870624563727488:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 23530us (23816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966935.990469:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00010000:00010000:3.0:1783966936.119746:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783966936.124958:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1783966936.124976:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1783966936.899766:0:14263:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783966936.900541:0:14263:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783966936.900592:0:14263:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783966936.900599:0:14263:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783966936.952131:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966936.952142:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966936.952186:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783966936.952194:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966936.952351:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587913728:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783966936.952452:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966936.961889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966936.961931:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563728000 00000100:00100000:0.0:1783966936.961940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563728000 00000100:00100000:0.0:1783966936.962001:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:0.0:1783966936.962012:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:11404:x1870624563728000:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783966936.962051:0:6518:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783966936.962171:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:11404:x1870624563728000:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966936.962179:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00080000:0.0:1783966936.962200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966936.962390:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587913728:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783966936.978679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966936.978990:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563728256 00000100:00100000:0.0:1783966936.979001:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563728256 00000100:00100000:0.0:1783966936.979066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:0.0:1783966936.979076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:11404:x1870624563728256:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966936.979112:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966936.979134:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160677a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dcf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.979245:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160677a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.979276:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160677a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.979289:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160677a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966936.979302:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783966936.979414:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b3160677a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dcf expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.979432:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160677a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dcf expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.979446:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966936.979449:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966936.979453:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783966936.979528:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:11404:x1870624563728256:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 453us (859us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783966936.979536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:1.0:1783966936.989327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966936.989400:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966936.989439:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563728512 00000100:00100000:1.0:1783966936.989449:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563728512 00000100:00100000:1.0:1783966936.989507:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:1.0:1783966936.989518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:11404:x1870624563728512:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783966936.989608:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966936.991044:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563728640 00000100:00100000:0.0:1783966936.991058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563728640 00000100:00100000:0.0:1783966936.991120:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1783966936.991130:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:2402:x1870624563728640:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966936.991147:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966936.991870:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.991892:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.992948:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b3160677a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dcf expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966936.992983:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:0.0:1783966936.992989:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966936.993060:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:2402:x1870624563728640:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1930us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966936.993071:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00010000:00010000:1.0:1783966936.998143:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998166:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998183:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998190:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966936.998195:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998206:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998227:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966936.998231:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966936.998236:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966936.998244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677b5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966936.998461:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:11404:x1870624563728512:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 8937us (9150us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783966936.998474:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000040:00080000:3.0:1783966936.998506:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783966936.998525:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1783966937.004356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966937.004392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563728896 00000100:00100000:1.0:1783966937.004402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563728896 00000100:00100000:1.0:1783966937.004455:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1783966937.004466:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:11404:x1870624563728896:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1783966937.004835:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783966937.004864:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783966937.005263:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:11404:x1870624563728896:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 796us (914us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1783966937.005282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00010000:00010000:0.0:1783966937.154095:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966938.167096:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966938.487341:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966938.487367:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587913856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783966938.487442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966938.488326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587913856 00000100:00100000:3.0:1783966938.488337:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587913856 00000100:00100000:3.0:1783966938.488405:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783966938.488415:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587913856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783966938.488454:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783966938.491973:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587913856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3549us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966938.491990:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783966938.492112:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587913856:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1783966938.920016:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783966938.920025:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783966938.920058:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783966938.920070:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783966939.164008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966939.164083:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729152 00000100:00100000:2.0:1783966939.164098:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729152 00000100:00100000:2.0:1783966939.164189:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:2.0:1783966939.164200:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:11426:x1870624563729152:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966939.164241:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966939.164262:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160677bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6dd6 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966939.164373:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160677c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966939.164388:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160677c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966939.164402:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160677c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966939.164412:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783966939.164518:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b3160677bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dd6 expref: 28 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966939.164554:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160677c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dd6 expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966939.164563:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:2.0:1783966939.164565:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783966939.164568:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631800, rc 0) 00000100:00100000:2.0:1783966939.164639:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:11426:x1870624563729152:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 441us (643us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783966939.164645:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00080000:0.0:1783966939.164890:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966939.182856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966939.189091:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729280 00000100:00100000:1.0:1783966939.189103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729280 00000100:00100000:1.0:1783966939.189171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:1.0:1783966939.189181:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:11426:x1870624563729280:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783966939.189386:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189403:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189415:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189452:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189460:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189524:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189542:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966939.189547:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189555:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189569:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966939.189572:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783966939.189576:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.189583:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f400/0x9269c8b3160677d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966939.189675:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:11426:x1870624563729280:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 494us (6828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966939.189683:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00010000:00010000:2.0:1783966939.205760:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966939.373726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966939.373890:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729408 00000100:00100000:1.0:1783966939.373902:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729408 00000100:00100000:1.0:1783966939.373984:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783966939.373997:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2402:x1870624563729408:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1783966939.374016:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966939.374039:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90c67e6/0x9269c8b3160677d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ddd expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783966939.374066:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a552cd6, atime: 0x6a552cd5, ctime: 0x6a552cd6, blocks: 0x8 00010000:00010000:1.0:1783966939.374089:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1783966939.374107:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966939.374118:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90c67e6/0x9269c8b3160677d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ddd expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.374140:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e90c67e6/0x9269c8b3160677d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ddd expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966939.374155:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f400, rc 0) 00000100:00080000:0.0:1783966939.374306:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966939.374346:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563729408:12345-192.168.204.59@tcp:101:cat.0 Request processed in 352us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966939.374354:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783966939.386003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966939.386103:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729536 00000100:00100000:3.0:1783966939.386114:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729536 00002000:00100000:3.0:1783966939.386171:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9a04c443f100 x1870624563729536/t0(0) o3->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:100/0 lens 488/0 e 0 to 0 dl 1783966950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966939.386183:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c443f100 with x1870624563729536 ext(0->4095) 00002000:00010000:3.0:1783966939.386190:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c443f100 00000100:00100000:3.0:1783966939.386334:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1783966939.386346:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563729536:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:3.0:1783966939.386612:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563729536:12345-192.168.204.59@tcp:3:cat.0 Request processed in 266us (619us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1783966939.386621:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:3.0:1783966939.386629:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9a04c443f100 x1870624563729536/t0(0) o3->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:100/0 lens 488/4536 e 0 to 0 dl 1783966950 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783966939.386638:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c443f100 with x1870624563729536 ext(0->4095) 00002000:00010000:3.0:1783966939.386641:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c443f100 00000100:00100000:3.0:1783966939.396392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966939.396433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966939.396523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966939.396554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966939.396575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966939.396624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729664 00000100:00100000:0.0:1783966939.396634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729664 00000100:00100000:0.0:1783966939.396689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 386 00000100:00100000:0.0:1783966939.396700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563729664:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966939.396794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563729664:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966939.396814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 386 00000100:00100000:0.0:1783966939.396851:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729920 00000100:00100000:0.0:1783966939.396854:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729920 00000100:00100000:0.0:1783966939.396888:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:0.0:1783966939.396895:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563729920:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966939.396922:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563729920:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966939.396929:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00080000:0.0:1783966939.396962:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966939.399630:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563729792 00000100:00100000:2.0:1783966939.399646:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563729792 00000100:00100000:2.0:1783966939.399719:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730048 00000100:00100000:2.0:1783966939.399724:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730048 00000100:00100000:2.0:1783966939.399745:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730176 00000100:00100000:2.0:1783966939.399748:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730176 00000100:00100000:2.0:1783966939.399789:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 310 00000100:00100000:2.0:1783966939.399800:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563729792:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966939.399895:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563729792:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 96us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966939.399904:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 310 00000100:00100000:2.0:1783966939.399922:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 311 00000100:00100000:2.0:1783966939.399930:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563730048:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966939.399957:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563730048:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966939.399977:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 311 00000100:00100000:2.0:1783966939.399991:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00100000:2.0:1783966939.399998:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563730176:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966939.400026:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563730176:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966939.400033:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 312 00000100:00080000:3.0:1783966939.403942:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966939.403951:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966940.025029:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783966940.025056:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587914112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966940.025126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025146:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587914368:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025178:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025213:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914368 00000100:00100000:2.0:1783966940.025220:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914368 00000100:00100000:2.0:1783966940.025268:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783966940.025270:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587913984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966940.025291:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587914368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.025296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966940.025317:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587914496:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.025339:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025339:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587914368:12345-0@lo:400:kworker.0 Request processed in 64us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.025346:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1783966940.025352:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587915008:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.025373:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025389:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587914368:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025395:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587914880:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025433:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587915392:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025451:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025466:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966940.025485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025517:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783966940.025531:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587914240:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025581:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587914752:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025616:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915264:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025652:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915776:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.025682:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.025715:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914112 00000100:00100000:2.0:1783966940.025718:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914112 00000100:00100000:2.0:1783966940.025748:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587913984 00000100:00100000:2.0:1783966940.025751:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587913984 00000100:00100000:2.0:1783966940.025762:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915904 00000100:00100000:2.0:1783966940.025764:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915904 00000100:00100000:2.0:1783966940.025818:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783966940.025824:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587914112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966940.025846:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966940.025879:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587914112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.025886:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783966940.025898:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783966940.025904:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587913984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966940.025913:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966940.025936:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587913984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.025942:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783966940.025960:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783966940.025966:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587915904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966940.025981:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783966940.026013:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587915904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026019:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783966940.026037:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914240 00000100:00100000:2.0:1783966940.026041:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914240 00000100:00100000:2.0:1783966940.026064:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783966940.026071:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587914240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587914240:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1783966940.026134:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915264 00000100:00100000:2.0:1783966940.026137:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915264 00000100:00100000:2.0:1783966940.026159:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915776 00000100:00100000:2.0:1783966940.026162:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915776 00000100:00100000:2.0:1783966940.026176:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966940.026183:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587915264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026213:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587915264:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026219:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783966940.026229:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966940.026235:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026260:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587915776:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026266:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783966940.026291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915008 00000100:00100000:2.0:1783966940.026295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915008 00000100:00100000:2.0:1783966940.026318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914880 00000100:00100000:2.0:1783966940.026320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914880 00000100:00100000:3.0:1783966940.026321:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587915520:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915392 00000100:00100000:2.0:1783966940.026335:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915392 00000100:00100000:2.0:1783966940.026349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783966940.026350:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966940.026354:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587915008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f63df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587915008:12345-0@lo:400:kworker.0 Request processed in 28us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1783966940.026398:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915520 00000100:00100000:2.0:1783966940.026400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915520 00000100:00100000:2.0:1783966940.026413:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783966940.026417:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587914880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026464:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587914880:12345-0@lo:400:kworker.0 Request processed in 46us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026470:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1783966940.026482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783966940.026488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587915392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026514:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587915392:12345-0@lo:400:kworker.0 Request processed in 27us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026519:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1783966940.026530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1783966940.026535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026559:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587915520:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.026573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1783966940.026608:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587914240:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026619:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915264:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026628:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1783966940.026633:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1783966940.026650:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a05f56ad880, transno 4294967302 00000004:00080000:2.0:1783966940.026662:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1783966940.026673:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3ea5500, transno 4294967305 00000100:00100000:2.0:1783966940.026677:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915776:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026688:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587914880:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026698:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587915392:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.026710:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587915904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966940.026755:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914496 00000100:00100000:2.0:1783966940.026758:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914496 00000100:00100000:3.0:1783966940.026902:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587914112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966940.026921:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587913984:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783966940.026946:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3e38000 x1870624587915008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966940.026956:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587915008:0@lo:400:kworker.0 00010000:00080000:3.0:1783966940.026965:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3e38a80 x1870624587915520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966940.026973:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587915520:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.026982:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783966940.026989:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587914624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.027016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966940.027032:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587915136:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.027049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966940.027070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914624 00000100:00100000:3.0:1783966940.027072:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587915648:0@lo:400:kworker.0 00000100:00100000:0.0:1783966940.027074:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914624 00000100:00100000:3.0:1783966940.027090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966940.027101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783966940.027107:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587914624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.027112:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915136 00000100:00100000:3.0:1783966940.027115:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915136 00000100:00100000:3.0:1783966940.027137:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587915648 00000100:00100000:3.0:1783966940.027140:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587915648 00000100:00100000:0.0:1783966940.027145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587914624:12345-0@lo:400:kworker.0 Request processed in 38us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966940.027151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783966940.027156:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783966940.027161:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587915136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966940.027290:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783966940.027298:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587915648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966940.027328:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587915648:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966940.027334:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1783966940.027375:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783966940.027378:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966940.027381:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966940.027383:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966940.027504:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966940.027514:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587916032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966940.027545:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966940.027588:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916032 00000100:00100000:1.0:1783966940.027592:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916032 00000100:00100000:1.0:1783966940.027630:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783966940.027637:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624587916032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966940.027651:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783966940.027676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587915136:12345-0@lo:400:kworker.0 Request processed in 514us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966940.027678:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624587916032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966940.027683:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783966940.027683:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783966940.027703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587914752 00000100:00100000:1.0:1783966940.027706:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587914752 00000100:00100000:3.0:1783966940.027720:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587914624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.027730:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587915136:0@lo:400:kworker.0 00000100:00100000:3.0:1783966940.027739:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587915648:0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.028119:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783966940.028189:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587914496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966940.028247:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587914496:12345-0@lo:400:kworker.0 Request processed in 119us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966940.028254:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783966940.028314:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587914496:0@lo:400:kworker.0 00000100:00100000:0.0:1783966940.028417:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587916032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966940.028516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783966940.028525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587914752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966940.028582:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587914752:12345-0@lo:400:kworker.0 Request processed in 59us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966940.028589:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783966940.028751:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587914752:0@lo:400:kworker.0 00010000:00010000:1.0:1783966940.221712:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966940.541283:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966940.541357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966940.541508:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916160 00000100:00100000:3.0:1783966940.541517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916160 00000100:00100000:3.0:1783966940.541585:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783966940.541594:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587916160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966940.541633:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783966940.553262:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587916160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11657us (11893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966940.553279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783966940.553641:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587916160:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966941.256734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783966941.561844:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1783966941.561882:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05c9dd4c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1783966941.561888:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f7d6e700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c9dd4480 00000020:00080000:1.0:1783966941.561892:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f7d6e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c3b72a00 00000020:00080000:1.0:1783966941.561924:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1783966941.561928:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.561942:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.561969:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.561975:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966941.561979:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.561987:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.562017:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a05f5465500) 00010000:00010000:2.0:1783966941.562021:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966941.562025:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966941.562032:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067753 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783966941.562580:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1783966941.562662:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1783966941.565410:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1783966941.565492:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1783966942.266841:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966943.159726:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783966943.159746:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783966943.159801:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783966943.159812:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783966943.287191:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783966943.352025:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783966943.607082:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587916288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966943.607158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966943.607749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916288 00000100:00100000:1.0:1783966943.607758:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916288 00000100:00100000:1.0:1783966943.607835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783966943.607928:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587916288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966943.607974:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966943.608106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587916288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 261us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966943.608114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783966943.617873:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587916288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966944.311163:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966944.522755:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522954:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.522992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966944.523027:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730304 00000100:00100000:3.0:1783966944.523037:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730304 00000100:00100000:3.0:1783966944.523091:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 388 00000100:00100000:3.0:1783966944.523102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563730304:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523175:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563730304:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 75us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523183:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 388 00000100:00100000:3.0:1783966944.523213:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730816 00000100:00100000:3.0:1783966944.523217:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730816 00000100:00100000:3.0:1783966944.523254:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730688 00000100:00100000:3.0:1783966944.523258:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730688 00000100:00100000:3.0:1783966944.523280:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:3.0:1783966944.523287:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563730816:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523316:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563730816:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523323:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:3.0:1783966944.523335:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1783966944.523342:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563730688:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523365:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563730688:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523384:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:3.0:1783966944.523408:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730560 00000100:00100000:3.0:1783966944.523411:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730560 00000100:00100000:3.0:1783966944.523443:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731072 00000100:00100000:3.0:1783966944.523446:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731072 00000100:00100000:3.0:1783966944.523471:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730432 00000100:00100000:3.0:1783966944.523474:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730432 00000100:00100000:3.0:1783966944.523484:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563730944 00000100:00100000:3.0:1783966944.523487:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563730944 00000100:00100000:3.0:1783966944.523499:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 319 00000100:00100000:3.0:1783966944.523506:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563730560:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523532:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563730560:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523539:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 319 00000100:00100000:3.0:1783966944.523550:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:3.0:1783966944.523556:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563731072:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523578:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563731072:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523584:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 320 00000100:00100000:3.0:1783966944.523594:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 321 00000100:00100000:3.0:1783966944.523599:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2400:x1870624563730432:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523620:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2400:x1870624563730432:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523626:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 321 00000100:00100000:3.0:1783966944.523637:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 322 00000100:00100000:3.0:1783966944.523642:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563730944:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966944.523665:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563730944:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966944.523671:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 322 00000100:00080000:3.0:1783966944.523870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966944.523879:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966944.523882:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966944.523884:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966944.754926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966944.755095:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731200 00000100:00100000:0.0:1783966944.755117:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731200 00000100:00100000:0.0:1783966944.755219:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:0.0:1783966944.755231:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:11079:x1870624563731200:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783966944.755390:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:11079:x1870624563731200:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 159us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966944.755414:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:3.0:1783966944.760636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966944.760867:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731328 00000100:00100000:0.0:1783966944.760878:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731328 00000100:00100000:0.0:1783966944.760934:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:0.0:1783966944.760945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:11079:x1870624563731328:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783966944.761062:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:11079:x1870624563731328:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 118us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966944.761071:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:1.0:1783966944.764674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966944.764919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731584 00000100:00100000:2.0:1783966944.764931:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731584 00000100:00100000:2.0:1783966944.764991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1783966944.765002:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:11079:x1870624563731584:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783966944.765257:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:11079:x1870624563731584:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 256us (592us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1783966944.765265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:1.0:1783966945.062920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966945.063342:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731712 00000100:00100000:3.0:1783966945.063352:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731712 00000100:00100000:3.0:1783966945.063419:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:3.0:1783966945.063431:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:11885:x1870624563731712:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:3.0:1783966945.063455:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966945.063478:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160677df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6de4 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063549:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063564:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063580:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966945.063636:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783966945.063640:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966945.063680:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063717:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160677df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 7 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063740:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 6 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966945.063824:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966945.063828:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783966945.063832:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0a00, rc 0) 00000100:00100000:3.0:1783966945.063915:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:11885:x1870624563731712:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 485us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.063923:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 149 00000100:00100000:0.0:1783966945.143154:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587916416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966945.143238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.143934:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916416 00000100:00100000:1.0:1783966945.143958:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916416 00000100:00100000:1.0:1783966945.144032:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783966945.144048:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587916416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783966945.144081:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783966945.144141:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587916416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966945.144149:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783966945.144200:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587916416:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783966945.144919:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966945.145191:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587916544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966945.145255:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145576:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587916928:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145614:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145640:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587917440:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145663:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145680:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587917952:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145736:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783966945.145742:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587916800:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145816:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587917312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966945.145860:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587917824:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.145882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966945.146051:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916928 00000100:00100000:3.0:1783966945.146059:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916928 00000100:00100000:3.0:1783966945.146097:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917440 00000100:00100000:3.0:1783966945.146100:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917440 00000100:00100000:3.0:1783966945.146120:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917952 00000100:00100000:3.0:1783966945.146123:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917952 00000100:00100000:3.0:1783966945.146136:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783966945.146145:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587916928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.146200:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587916928:12345-0@lo:400:kworker.0 Request processed in 56us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.146208:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1783966945.146224:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917824 00000100:00100000:3.0:1783966945.146227:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917824 00000100:00100000:3.0:1783966945.146243:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783966945.146249:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587917440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.146278:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587917440:12345-0@lo:400:kworker.0 Request processed in 29us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.146284:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1783966945.146294:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783966945.146300:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587917952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.146415:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916544 00000100:00100000:0.0:1783966945.146419:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916544 00000100:00100000:0.0:1783966945.146451:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783966945.146458:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587916544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966945.146481:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783966945.146518:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587916544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966945.146525:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1783966945.146760:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966945.146765:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966945.146792:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966945.146809:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783966945.146817:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587917824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.146849:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587917824:12345-0@lo:400:kworker.0 Request processed in 34us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966945.146867:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783966945.146913:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587916672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966945.146960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966945.146986:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587917184:0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.147008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966945.147024:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587917696:0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.147048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966945.147068:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966945.147086:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.147302:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587917056:0@lo:400:kworker.0 00000100:00100000:1.0:1783966945.147589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.147617:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587917568:0@lo:400:kworker.0 00000100:00100000:1.0:1783966945.147639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.147650:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587918080:0@lo:400:kworker.0 00000100:00100000:1.0:1783966945.147666:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.147722:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587916544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966945.147841:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587917952:12345-0@lo:400:kworker.0 Request processed in 1540us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.147849:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1783966945.147866:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917184 00000100:00100000:3.0:1783966945.147871:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917184 00000100:00100000:2.0:1783966945.149492:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917568 00000100:00100000:2.0:1783966945.149506:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917568 00000100:00100000:2.0:1783966945.149587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1783966945.149598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587917184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.149682:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587917184:12345-0@lo:400:kworker.0 Request processed in 87us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.149690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1783966945.149789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1783966945.149800:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587917568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.149821:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917696 00000100:00100000:3.0:1783966945.149827:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917696 00000100:00100000:2.0:1783966945.149848:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587917568:12345-0@lo:400:kworker.0 Request processed in 50us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.149855:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1783966945.149864:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918080 00000100:00100000:3.0:1783966945.149869:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918080 00000100:00100000:2.0:1783966945.149900:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916800 00000100:00100000:2.0:1783966945.149905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916800 00000100:00100000:3.0:1783966945.149916:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783966945.149926:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587917696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.149937:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1783966945.149947:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587916800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.149971:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587917696:12345-0@lo:400:kworker.0 Request processed in 48us (2921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.149979:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783966945.149997:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783966945.149997:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587916800:12345-0@lo:400:kworker.0 Request processed in 51us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.150011:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1783966945.150012:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.150052:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587918080:12345-0@lo:400:kworker.0 Request processed in 45us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.150059:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783966945.150066:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917312 00000100:00100000:2.0:1783966945.150071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917312 00000100:00100000:2.0:1783966945.150093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587917056 00000100:00100000:2.0:1783966945.150096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587917056 00000100:00100000:2.0:1783966945.150113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783966945.150120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587917312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.150476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587917312:12345-0@lo:400:kworker.0 Request processed in 356us (4633us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966945.150485:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587916800:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.150485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783966945.150505:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783966945.150513:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587917312:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.150515:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587917056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.150535:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587917824:0@lo:400:kworker.0 00000100:00100000:3.0:1783966945.150553:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587916928:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.150558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587917056:12345-0@lo:400:kworker.0 Request processed in 45us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.150566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783966945.150570:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587917440:0@lo:400:kworker.0 00010000:00080000:3.0:1783966945.150600:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c452ed80 x1870624587917952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783966945.150607:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966945.150612:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587917952:0@lo:400:kworker.0 00000100:00080000:2.0:1783966945.150613:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966945.150620:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966945.150792:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587917184:0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.150810:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1783966945.150815:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1783966945.150833:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587917696:0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.150883:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587917056:0@lo:400:kworker.0 00010000:00080000:0.0:1783966945.150910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c452df80 x1870624587917568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966945.150921:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587917568:0@lo:400:kworker.0 00000100:00100000:0.0:1783966945.150935:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587918080:0@lo:400:kworker.0 00000100:00100000:2.0:1783966945.155506:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587916672 00000100:00100000:2.0:1783966945.155521:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587916672 00000100:00100000:2.0:1783966945.155581:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918208 00000100:00100000:2.0:1783966945.155584:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918208 00000100:00100000:2.0:1783966945.155625:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783966945.155634:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587916672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966945.155660:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966945.155788:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587916672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (8826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.155797:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783966945.155814:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783966945.155820:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966945.155831:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783966945.155861:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (8773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966945.155867:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783966945.156386:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587916672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966945.156405:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783966945.335433:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966945.655186:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587918336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966945.655267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966945.655410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918336 00000100:00100000:1.0:1783966945.655418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918336 00000100:00100000:1.0:1783966945.655476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783966945.655487:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587918336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966945.655524:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783966945.655573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587918336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966945.655581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1783966945.655751:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587918336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966946.359809:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966947.383687:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783966947.711299:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1783966947.711379:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1783966947.711556:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1783966947.711570:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1783966948.411351:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966948.728981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587918464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966948.729069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966948.729174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918464 00000100:00100000:1.0:1783966948.729183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918464 00000100:00100000:1.0:1783966948.729243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783966948.729253:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587918464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966948.729293:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966948.729340:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587918464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966948.729347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783966948.729625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587918464:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1783966948.790145:0:14512:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:22:26 (1783966946) 00010000:00010000:3.0:1783966949.431331:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966949.631910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.631953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.631987:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.632015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.632040:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.632066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966949.632096:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966949.632111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731968 00000100:00100000:2.0:1783966949.632131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731968 00000100:00100000:3.0:1783966949.632135:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563731840 00000100:00100000:3.0:1783966949.632147:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563731840 00000100:00100000:3.0:1783966949.632216:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 390 00000100:00100000:2.0:1783966949.632226:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732480 00000100:00100000:2.0:1783966949.632234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732480 00000100:00100000:3.0:1783966949.632236:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563731840:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966949.632261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732096 00000100:00100000:2.0:1783966949.632266:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732096 00000100:00100000:2.0:1783966949.632294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 329 00000100:00100000:2.0:1783966949.632308:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2403:x1870624563731968:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966949.632346:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563731840:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 116us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966949.632375:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 390 00000100:00100000:2.0:1783966949.632397:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2403:x1870624563731968:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 91us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966949.632423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 329 00000100:00100000:3.0:1783966949.632436:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732608 00000100:00100000:3.0:1783966949.632443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732608 00000100:00100000:2.0:1783966949.632453:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 330 00000100:00100000:3.0:1783966949.632484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 331 00000100:00100000:3.0:1783966949.632493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563732096:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966949.632537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563732096:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 45us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966949.632544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 331 00000100:00100000:3.0:1783966949.632558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 332 00000100:00100000:3.0:1783966949.632564:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563732608:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966949.632585:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563732608:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966949.632592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 332 00000100:00100000:3.0:1783966949.632622:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732224 00000100:00100000:2.0:1783966949.632625:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2403:x1870624563732480:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966949.632628:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732224 00000100:00100000:3.0:1783966949.632671:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732352 00000100:00100000:3.0:1783966949.632676:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732352 00000100:00100000:2.0:1783966949.632685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2403:x1870624563732480:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 222us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966949.632694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 330 00000100:00100000:3.0:1783966949.632707:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:3.0:1783966949.632717:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563732224:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:2.0:1783966949.632725:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783966949.632732:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966949.632736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966949.632740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966949.632762:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563732224:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 44us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966949.632806:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:3.0:1783966949.632831:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:3.0:1783966949.632840:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563732352:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966949.632888:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563732352:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 49us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966949.632896:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:3.0:1783966950.263431:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783966950.263454:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966950.263532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966950.263606:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966950.263643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.263685:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918720 00000100:00100000:2.0:1783966950.263694:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918720 00000100:00100000:2.0:1783966950.263758:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918592 00000100:00100000:2.0:1783966950.263762:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918592 00000100:00080000:3.0:1783966950.263763:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966950.263792:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966950.263804:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783966950.263816:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966950.263851:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1783966950.263918:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.263926:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783966950.263940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783966950.263952:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966950.263974:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966950.264011:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587918976:0@lo:400:kworker.0 00000100:00100000:0.0:1783966950.264028:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587918592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966950.264036:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783966950.264048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.264088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918976 00000100:00100000:2.0:1783966950.264091:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918976 00000100:00100000:2.0:1783966950.264122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783966950.264130:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587918976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587918976:12345-0@lo:400:kworker.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.264198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1783966950.264232:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587919104:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.264321:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966950.264328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587919488:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.264375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919488 00000100:00100000:2.0:1783966950.264379:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919488 00000100:00100000:2.0:1783966950.264409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1783966950.264415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587919488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264449:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587919488:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.264455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:2.0:1783966950.264474:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966950.264501:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587919488:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587919616:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.264715:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919616 00000100:00100000:2.0:1783966950.264720:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919616 00000100:00100000:2.0:1783966950.264753:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1783966950.264760:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587919616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264825:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587919616:12345-0@lo:400:kworker.0 Request processed in 65us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.264831:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1783966950.264855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1783966950.264877:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3e3aa00 x1870624587919616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966950.264888:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587919616:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.264897:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587919232:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.264936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.264944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966950.264955:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587920000:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.264977:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587919744:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.264984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966950.265011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.265017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919232 00000100:00100000:2.0:1783966950.265021:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919232 00000100:00100000:1.0:1783966950.265036:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783966950.265044:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587918848:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.265047:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587920000 00000100:00100000:2.0:1783966950.265051:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587920000 00000100:00100000:1.0:1783966950.265077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.265078:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1783966950.265086:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587919232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.265119:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587919360:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.265127:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587919232:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.265135:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1783966950.265152:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783966950.265156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.265163:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587920000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.265182:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587919872:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.265207:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587920000:12345-0@lo:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.265216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966950.265221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1783966950.265234:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919872 00000100:00100000:2.0:1783966950.265238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919872 00000100:00100000:1.0:1783966950.265248:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587919232:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.265282:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919104 00000100:00100000:1.0:1783966950.265286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919104 00000100:00100000:1.0:1783966950.265315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919360 00000100:00100000:1.0:1783966950.265318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919360 00000100:00100000:1.0:1783966950.265337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783966950.265345:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587919104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966950.265386:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587918976:0@lo:400:kworker.0 00000100:00100000:0.0:1783966950.265424:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587919744 00000100:00100000:0.0:1783966950.265427:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587919744 00000100:00100000:0.0:1783966950.265458:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783966950.265465:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587919744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.265498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1783966950.265506:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587919872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.270625:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587919104:12345-0@lo:400:kworker.0 Request processed in 5268us (6351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.270651:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783966950.270695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783966950.270708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587919360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.270795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587919360:12345-0@lo:400:kworker.0 Request processed in 93us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.270802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783966950.270841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587918848 00000100:00100000:1.0:1783966950.270850:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587918848 00000100:00100000:1.0:1783966950.270893:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1783966950.270900:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587918848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.270936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587918848:12345-0@lo:400:kworker.0 Request processed in 36us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.270942:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1783966950.271010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587918848:0@lo:400:kworker.0 00000100:00100000:3.0:1783966950.271426:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966950.271444:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587918592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966950.271474:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587919360:0@lo:400:kworker.0 00000100:00080000:3.0:1783966950.271523:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966950.271530:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966950.271533:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966950.271572:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783966950.271604:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587920256:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.271640:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966950.271653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966950.271653:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587920384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966950.271693:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587920256 00000100:00100000:1.0:1783966950.271694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966950.271699:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587920256 00000100:00100000:1.0:1783966950.271742:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783966950.271744:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783966950.271755:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587920128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966950.271757:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587920256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966950.271832:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587920256:12345-0@lo:400:kworker.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966950.271840:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783966950.271861:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966950.271886:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587920256:0@lo:400:kworker.0 00010000:00080000:3.0:1783966950.271955:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c4c70380 x1870624587920000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966950.271955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966950.271970:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587920000:0@lo:400:kworker.0 00000100:00100000:3.0:1783966950.271987:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587919104:0@lo:400:kworker.0 00000100:00100000:1.0:1783966950.271998:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587920384 00000100:00100000:1.0:1783966950.272003:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587920384 00000100:00100000:3.0:1783966950.272027:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587920128 00000100:00100000:3.0:1783966950.272032:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587920128 00000100:00100000:3.0:1783966950.272057:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783966950.272063:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587920128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966950.272079:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966950.272117:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587920128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966950.272124:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783966950.272384:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783966950.272393:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587920384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966950.272407:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783966950.272448:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587920384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.272454:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783966950.273158:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587919744:12345-0@lo:400:kworker.0 Request processed in 7687us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966950.273170:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783966950.273216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587920384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966950.273226:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587920128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966950.273239:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587919744:0@lo:400:kworker.0 00000100:00100000:2.0:1783966950.279728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624587919872:12345-0@lo:400:kworker.0 Request processed in 14211us (14503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.279787:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1783966950.279957:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624587919872:0@lo:400:kworker.0 00000100:00100000:3.0:1783966950.404574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966950.404806:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732864 00000100:00100000:1.0:1783966950.404825:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732864 00000100:00100000:1.0:1783966950.404975:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:1.0:1783966950.404989:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:12152:x1870624563732864:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966950.405029:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966950.405062:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160677ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6deb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405141:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405156:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405173:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405188:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405217:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405224:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405341:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067802 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405350:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405357:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966950.405367:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783966950.405481:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405489:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405496:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405502:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966950.405506:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405514:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405536:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c1cc7a00) 00010000:00010000:1.0:1783966950.405538:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966950.405543:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405549:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b3160677f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405563:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405569:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405575:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405580:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966950.405583:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405589:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405607:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a05f1a82c00) 00010000:00010000:1.0:1783966950.405609:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966950.405612:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.405617:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160677fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.406576:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b3160677ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6deb expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.406607:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067802 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6deb expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966950.406615:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:1.0:1783966950.406617:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966950.406620:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e200, rc 0) 00000100:00100000:1.0:1783966950.406699:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:12152:x1870624563732864:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1713us (2139us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1783966950.406708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1783966950.417088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966950.417211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966950.417362:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563732992 00000100:00100000:1.0:1783966950.417376:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563732992 00000100:00100000:1.0:1783966950.417447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:1.0:1783966950.417458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:12152:x1870624563732992:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783966950.417580:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:12152:x1870624563732992:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.417587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:3.0:1783966950.417831:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733120 00000100:00100000:3.0:1783966950.417845:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733120 00000100:00100000:2.0:1783966950.418017:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:2.0:1783966950.418030:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:2403:x1870624563733120:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966950.418051:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966950.418091:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067802 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6deb expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966950.418117:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:2.0:1783966950.418123:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966950.418194:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:2403:x1870624563733120:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 167us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.418202:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783966950.430093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966950.430230:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733248 00000100:00100000:2.0:1783966950.430243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733248 00000100:00100000:2.0:1783966950.430334:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:2.0:1783966950.430349:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:12152:x1870624563733248:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783966950.430526:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:12152:x1870624563733248:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 181us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966950.430537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 152 00010000:00010000:0.0:1783966950.455197:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966950.521531:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783966950.776950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587920512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966950.777060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966950.778450:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587920512 00000100:00100000:1.0:1783966950.778469:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587920512 00000100:00100000:1.0:1783966950.778577:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783966950.778599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587920512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966950.778661:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783966950.778759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587920512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966950.778821:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783966950.779511:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587920512:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783966951.361532:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966951.361545:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966951.365107:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783966951.365132:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783966951.479940:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966952.503058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966952.879227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966952.879306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733376 00000100:00100000:2.0:1783966952.879325:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733376 00000100:00100000:2.0:1783966952.879407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:2.0:1783966952.879420:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:12194:x1870624563733376:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966952.879444:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966952.879468:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6df2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879560:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879576:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879589:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879604:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879611:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879665:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879672:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879678:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879690:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966952.879695:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879703:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879717:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966952.879720:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966952.879725:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879731:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879744:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879750:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879756:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879761:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966952.879764:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879796:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879815:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a04c1ccab00) 00010000:00010000:2.0:1783966952.879817:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966952.879820:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606781e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879857:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067810 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6df2 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879869:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966952.879872:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966952.879876:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6df2 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.879885:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00080000:3.0:1783966952.880318:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783966952.880364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:12194:x1870624563733376:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 946us (1145us total) trans 0 rc 301/301 00000100:00100000:2.0:1783966952.880372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1783966952.894264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966952.894736:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733632 00000100:00100000:2.0:1783966952.894748:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733632 00000100:00100000:2.0:1783966952.894855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:2.0:1783966952.894868:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:12194:x1870624563733632:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:2.0:1783966952.894934:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966952.894972:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067164 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c16 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.895011:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966952.895017:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966952.895096:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.895112:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 5 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.895121:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.895159:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 5 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.895174:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 5 pid: 7847 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966952.895190:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587920640:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966952.895286:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c82a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966952.902157:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966952.902196:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733760 00000100:00100000:0.0:1783966952.902206:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733760 00000100:00080000:2.0:1783966952.902267:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783966952.902291:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 6 pid: 7847 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966952.902370:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:0.0:1783966952.902382:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2400:x1870624563733760:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966952.902398:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966952.902411:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 6 pid: 7847 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902425:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 6 pid: 7847 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902456:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966952.902462:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902472:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902479:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902514:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966952.902591:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2400:x1870624563733760:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 212us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966952.902600:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00010000:00010000:0.0:1783966952.902752:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b3160677e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6de4 expref: 5 pid: 7847 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966952.902790:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587920640:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966952.902820:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902828:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902834:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902857:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902867:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.902875:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903493:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903506:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903514:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966952.903529:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074d16b6b reply state 0000000064a469e6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903541:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903572:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966952.903576:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966952.903580:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783966952.903586:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783966952.903595:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903601:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903607:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903614:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966952.903618:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903625:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903635:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966952.903637:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966952.903640:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903645:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067825 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966952.903661:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074d16b6b reply state 0000000064a469e6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903684:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966952.903690:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966952.903692:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966952.903694:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783966952.903799:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:12194:x1870624563733632:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 8932us (9544us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783966952.903809:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:0.0:1783966952.994162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966952.994263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563733888 00000100:00100000:2.0:1783966952.994274:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563733888 00000100:00100000:2.0:1783966952.994338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:2.0:1783966952.994348:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+15:12202:x1870624563733888:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:2.0:1783966952.994373:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966952.994396:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606783a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6df9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994495:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994511:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994525:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966952.994584:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966952.994589:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966952.994615:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994641:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b31606783a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6df9 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994659:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6df9 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966952.994668:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:2.0:1783966952.994671:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966952.994675:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783966952.994740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:12202:x1870624563733888:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 393us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966952.994747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:2.0:1783966953.074950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966953.075117:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734016 00000100:00100000:0.0:1783966953.075129:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734016 00000100:00100000:0.0:1783966953.075266:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:0.0:1783966953.075278:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+16:12208:x1870624563734016:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966953.075301:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966953.075327:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e00 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075461:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075475:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075487:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075499:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075519:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075595:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.075763:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076436:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076447:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966953.076486:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783966953.076492:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966953.076512:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076525:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076599:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076607:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.076613:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966953.076617:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077076:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077091:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:0.0:1783966953.077094:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966953.077099:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077105:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b31606784f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077121:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077128:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077134:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077139:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966953.077141:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077147:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077155:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966953.077157:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966953.077160:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077179:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077494:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e00 expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077510:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e00 expref: 17 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.077517:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966953.077519:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783966953.077522:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0e00, rc 0) 00000100:00100000:0.0:1783966953.078203:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:12208:x1870624563734016:12345-192.168.204.59@tcp:101:bash.0 Request processed in 2923us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966953.078212:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 156 00000100:00100000:0.0:1783966953.090637:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.090803:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734272 00000100:00100000:2.0:1783966953.090823:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734272 00000100:00100000:2.0:1783966953.090893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 157 00000100:00100000:2.0:1783966953.090903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:12208:x1870624563734272:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966953.090925:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966953.090948:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067864 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e07 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091065:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091093:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091107:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091113:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091120:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783966953.091765:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1783966953.091950:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.091961:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.092168:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092563:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092584:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092591:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092597:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966953.092603:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092610:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092624:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966953.092628:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966953.092632:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092639:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606786b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783966953.092654:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000661a60d7 reply state 000000003b5a2ac1 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092666:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092673:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00010000:00010000:3.0:1783966953.092675:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966953.092678:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783966953.092718:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067864 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092740:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.092748:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:3.0:1783966953.092750:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966953.092753:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630e00, rc 0) 00000100:00100000:3.0:1783966953.092921:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f1a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12208:x1870624563734272:12345-192.168.204.59@tcp:101:bash.0 Request processed in 2018us (2294us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1783966953.092930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 157 00000100:00100000:1.0:1783966953.108627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.108839:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734400 00000100:00100000:3.0:1783966953.108859:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734400 00000100:00100000:3.0:1783966953.108970:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1783966953.108985:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2401:x1870624563734400:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966953.109011:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966953.109043:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e0e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783966953.109077:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783966953.109104:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1783966953.109110:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.109122:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.109158:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.109203:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00080000:2.0:1783966953.109313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966953.109508:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2401:x1870624563734400:12345-192.168.204.59@tcp:101:bash.0 Request processed in 525us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.109518:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:0.0:1783966953.117575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.117820:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734528 00000100:00100000:3.0:1783966953.117834:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734528 00000100:00100000:3.0:1783966953.117910:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1783966953.117923:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:12208:x1870624563734528:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966953.117949:0:8714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966953.117975:0:8714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e15 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.118017:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.118027:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.118032:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.118038:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 7 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.118084:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.118102:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.118282:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587920768:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966953.118623:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966953.126414:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587920768:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966953.126479:0:8714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 7 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.126508:0:8714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:3.0:1783966953.126608:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:12208:x1870624563734528:12345-192.168.204.59@tcp:101:bash.0 Request processed in 8687us (9048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.126620:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1783966953.128359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.128461:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734656 00000100:00100000:3.0:1783966953.128473:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734656 00010000:00010000:3.0:1783966953.128530:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.128592:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1783966953.129425:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563734656:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966953.129448:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966953.129482:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.129499:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.129570:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b316067887 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e0e expref: 7 pid: 8433 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.130384:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.130396:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.130412:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.130438:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.130511:0:9532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.130532:0:9532:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9532:1870624587920896:192.168.204.59@tcp:105: 00000100:00100000:3.0:1783966953.130676:0:9532:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783966953.140745:0:9532:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d95500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9532:1870624587920896:192.168.204.59@tcp:105: 00010000:00010000:3.0:1783966953.140819:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966953.140899:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563734656:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 11485us (12551us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.140912:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:0.0:1783966953.143408:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.145765:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563734912 00000100:00100000:1.0:1783966953.145840:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563734912 00000100:00100000:1.0:1783966953.145934:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783966953.145947:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12208:x1870624563734912:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:1.0:1783966953.146369:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12208:x1870624563734912:12345-192.168.204.59@tcp:35:bash.0 Request processed in 423us (2974us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783966953.146378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783966953.305760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.306998:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563735168 00000100:00100000:2.0:1783966953.307016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563735168 00000100:00100000:2.0:1783966953.307125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:2.0:1783966953.307149:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12218:x1870624563735168:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966953.307186:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966953.307215:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e1c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966953.307356:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783966953.307496:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067895 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e1c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.307516:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:2.0:1783966953.307520:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783966953.307528:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e1c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.307565:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783966953.307751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12218:x1870624563735168:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 614us (2007us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1783966953.307760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 158 00000100:00100000:0.0:1783966953.322867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.323013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563735424 00000100:00100000:1.0:1783966953.323024:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563735424 00000100:00100000:1.0:1783966953.323088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1783966953.323099:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12218:x1870624563735424:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966953.323343:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12218:x1870624563735424:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 245us (484us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783966953.323351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000040:00080000:2.0:1783966953.400563:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966953.400573:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966953.400689:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1783966953.400698:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783966953.488963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.489065:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563735552 00000100:00100000:1.0:1783966953.489078:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563735552 00000100:00100000:1.0:1783966953.489150:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:1.0:1783966953.489161:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12224:x1870624563735552:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966953.489196:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966953.489223:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160678a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e23 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489327:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489343:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489355:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966953.489402:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783966953.489406:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966953.489437:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489466:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b3160678a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e23 expref: 25 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489486:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e23 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.489495:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966953.489498:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966953.489502:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fa00, rc 0) 00000100:00100000:1.0:1783966953.489579:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12224:x1870624563735552:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 419us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966953.489587:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 159 00000100:00100000:0.0:1783966953.500547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.500713:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563735808 00000100:00100000:3.0:1783966953.500725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563735808 00000100:00100000:3.0:1783966953.500848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:3.0:1783966953.500862:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12224:x1870624563735808:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966953.500900:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966953.500923:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160678b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e2a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.501056:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160678b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.501072:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160678b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.501084:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160678b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966953.501096:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783966953.501297:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160678b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e2a expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.501319:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160678b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e2a expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.501329:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:3.0:1783966953.501332:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966953.501336:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0600, rc 0) 00000100:00100000:3.0:1783966953.501403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12224:x1870624563735808:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 545us (883us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1783966953.501411:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 160 00000100:00100000:3.0:1783966953.507636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.507823:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736064 00000100:00100000:2.0:1783966953.507834:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736064 00000100:00100000:2.0:1783966953.507890:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:2.0:1783966953.507900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12224:x1870624563736064:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966953.507923:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966953.507943:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.508053:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.508067:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.508078:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966953.508089:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783966953.508186:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e31 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.508217:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e31 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.508226:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:2.0:1783966953.508230:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783966953.508232:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:2.0:1783966953.508295:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12224:x1870624563736064:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 397us (669us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1783966953.508319:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 161 00000100:00100000:0.0:1783966953.513572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.513669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736192 00000100:00100000:3.0:1783966953.513680:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736192 00000100:00100000:3.0:1783966953.513798:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1783966953.513809:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:2402:x1870624563736192:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966953.513828:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966953.513857:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b3160678b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e2a expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.513877:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:3.0:1783966953.513882:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966953.513941:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:2402:x1870624563736192:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 134us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.513950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1783966953.517665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.517844:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736320 00000100:00100000:3.0:1783966953.517854:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736320 00000100:00100000:3.0:1783966953.517916:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1783966953.517927:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563736320:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:3.0:1783966953.517986:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.518012:0:14225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.518027:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966953.518032:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966953.518037:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.518077:0:14225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.518104:0:14225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 6 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.518119:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c452d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14225:1870624587921024:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966953.518235:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2780 going to sleep for 11 seconds 00010000:00010000:1.0:1783966953.527213:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966953.534395:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c452d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14225:1870624587921024:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966953.534429:0:14225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966953.536600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966953.536832:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736448 00000100:00100000:0.0:1783966953.536843:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736448 00002000:00100000:0.0:1783966953.536888:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a04c3e38000 x1870624563736448/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:114/0 lens 504/0 e 0 to 0 dl 1783966964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783966953.536967:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3e38000 with x1870624563736448 ext(0->12) 00010000:00010000:0.0:1783966953.536978:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 7 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.536995:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 7 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783966953.537003:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3e38000 00000100:00100000:0.0:1783966953.537038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1783966953.537049:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563736448:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:1.0:1783966953.539025:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563736448:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 1967us (2423us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783966953.539044:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00002000:00100000:1.0:1783966953.539057:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a04c3e38000 x1870624563736448/t4294967306(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:114/0 lens 504/448 e 0 to 0 dl 1783966964 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783966953.539067:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3e38000 with x1870624563736448 ext(0->12) 00010000:00010000:1.0:1783966953.539077:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.539095:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783966953.539103:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3e38000 00000100:00100000:0.0:1783966953.543741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.547681:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736576 00000100:00100000:2.0:1783966953.547701:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736576 00010000:00010000:2.0:1783966953.547784:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966953.547908:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1783966953.547919:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563736576:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966953.547936:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783966953.547967:0:13736:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783966953.547971:0:13736:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783966952 00002000:00010000:2.0:1783966953.547973:0:13736:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783966952 00002000:00010000:2.0:1783966953.547976:0:13736:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783966952 00002000:00010000:2.0:1783966953.547978:0:13736:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783966953.547985:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.548002:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.548026:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b31606788e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e15 expref: 9 pid: 8714 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.548043:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966953.548048:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966953.548054:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.548090:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.548130:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966953.548202:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563736576:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 283us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966953.548211:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00010000:00010000:3.0:1783966953.548236:0:14225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548247:0:14225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548267:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548274:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548282:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548300:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966953.548304:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548313:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548328:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.548335:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160678db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.548396:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563736320:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 30471us (30743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.548405:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1783966953.563269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.563571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736832 00000100:00100000:2.0:1783966953.563583:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736832 00000100:00100000:2.0:1783966953.563652:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1783966953.563663:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12224:x1870624563736832:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:2.0:1783966953.563736:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e31 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783966953.563929:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1783966953.564029:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783966953.564806:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1783966953.564858:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.564877:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.564889:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.564929:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.564974:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 31 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966953.564990:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587921152:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966953.565122:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c82a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966953.568990:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587921152:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966953.569024:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966953.573819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966953.574431:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563736960 00000100:00100000:3.0:1783966953.574445:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563736960 00010000:00010000:3.0:1783966953.574496:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 32 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966953.574556:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:3.0:1783966953.574566:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:2401:x1870624563736960:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966953.574583:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966953.574590:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 32 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574620:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 32 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574647:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e07 expref: 32 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574668:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:3.0:1783966953.574675:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574685:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574693:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966953.574732:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966953.574853:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+31:2401:x1870624563736960:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 287us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966953.574862:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00010000:00010000:1.0:1783966953.576016:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.576030:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783966953.576171:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1783966953.576327:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1783966953.576444:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587921280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783966953.576524:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966953.576576:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c97f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1783966953.576707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587921280 00000100:00100000:2.0:1783966953.576715:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587921280 00000100:00100000:2.0:1783966953.576820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783966953.576830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587921280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783966953.576915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587921280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966953.576923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1783966953.577298:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966953.578172:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587921280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783966953.578389:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1783966953.578480:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587921408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783966953.578547:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966953.578582:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f89600 going to sleep for 11 seconds 00000100:00100000:2.0:1783966953.578837:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587921408 00000100:00100000:2.0:1783966953.578844:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587921408 00000100:00100000:2.0:1783966953.578897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783966953.578908:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1870624587921408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783966953.579051:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1870624587921408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (503us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783966953.579059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783966953.580252:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587921408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783966953.580338:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1783966953.580395:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580406:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580413:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580433:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966953.580438:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580446:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580463:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:1.0:1783966953.580466:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783966953.580470:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.580478:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160678e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783966953.580605:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783966953.580711:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1783966953.580723:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429781952338ns, next at 430781950361ns, rc = 0 00000001:00080000:1.0:1783966953.580729:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1783966953.580751:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c1ccac00) 00010000:00010000:1.0:1783966953.580754:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783966953.580762:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160678cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e31 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966953.580909:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:12224:x1870624563736832:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 17247us (17648us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1783966953.580919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000020:00080000:1.0:1783966953.580924:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783966953.584608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966953.585204:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563737088 00000100:00100000:0.0:1783966953.585214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563737088 00000100:00100000:0.0:1783966953.585279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 162 00000100:00100000:0.0:1783966953.585290:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:12224:x1870624563737088:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966953.585333:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966953.585472:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160678e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.585671:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160678e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e38 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.585689:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160678e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e38 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.585732:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966953.585735:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783966953.585739:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1000, rc 0) 00000100:00100000:0.0:1783966953.586135:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:12224:x1870624563737088:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 845us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966953.586144:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 162 00000040:00080000:2.0:1783966953.592248:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783966953.601664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.601751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563737344 00000100:00100000:1.0:1783966953.601764:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563737344 00000100:00100000:1.0:1783966953.601859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1783966953.601870:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:12224:x1870624563737344:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966953.602186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:12224:x1870624563737344:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 317us (533us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1783966953.602195:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1783966953.724960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.725606:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563737600 00000100:00100000:2.0:1783966953.725633:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563737600 00000100:00100000:2.0:1783966953.725705:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:2.0:1783966953.725715:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+36:12234:x1870624563737600:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966953.725739:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966953.725816:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160678f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e3f expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966953.725932:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783966953.726041:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160678f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e3f expref: 38 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.726057:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:2.0:1783966953.726060:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783966953.726065:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160678f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e3f expref: 38 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966953.726082:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783966953.726138:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12234:x1870624563737600:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 423us (1188us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1783966953.726146:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:3.0:1783966953.730813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.730995:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563737728 00000100:00100000:1.0:1783966953.731007:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563737728 00000100:00100000:1.0:1783966953.731071:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:1.0:1783966953.731081:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12234:x1870624563737728:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1783966953.731168:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731185:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731222:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731234:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731241:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731246:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731328:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731335:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731341:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966953.731395:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731408:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731414:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731421:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731436:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966953.731441:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731450:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731463:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966953.731466:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966953.731471:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731477:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b3160678fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731492:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731497:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731503:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731508:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966953.731511:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731518:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731545:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00010000:00010000:1.0:1783966953.731548:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966953.731552:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731559:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067905 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731570:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731576:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731581:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731587:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966953.731590:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731596:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731604:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966953.731606:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966953.731609:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.731615:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b31606790c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966953.731719:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12234:x1870624563737728:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 637us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966953.731728:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:0.0:1783966953.735174:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.735332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563737984 00000100:00100000:1.0:1783966953.735345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563737984 00000100:00100000:1.0:1783966953.735428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1783966953.735439:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12234:x1870624563737984:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966953.735725:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:12234:x1870624563737984:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 287us (560us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1783966953.735734:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:3.0:1783966953.784013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966953.784155:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563738240 00000100:00100000:0.0:1783966953.784166:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563738240 00000100:00100000:0.0:1783966953.784270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:0.0:1783966953.784281:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:12237:x1870624563738240:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966953.784309:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966953.784331:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067913 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784423:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784439:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784451:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784465:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784501:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784508:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784846:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784853:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784859:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966953.784866:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783966953.784932:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784937:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784942:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784946:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966953.784949:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784953:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784971:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966953.784973:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966953.784976:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784981:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b31606791a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784991:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784994:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.784998:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785002:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966953.785004:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785007:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785010:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00010000:00010000:0.0:1783966953.785012:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966953.785013:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785016:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067921 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785114:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067913 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785125:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966953.785131:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966953.785132:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966953.785134:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0200, rc 0) 00000100:00100000:0.0:1783966953.785283:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+40:12237:x1870624563738240:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1003us (1282us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1783966953.785288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:3.0:1783966953.789436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966953.789952:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563738368 00000100:00100000:1.0:1783966953.789964:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563738368 00000100:00100000:1.0:1783966953.790033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:1.0:1783966953.790046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+40:12237:x1870624563738368:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783966953.790126:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790144:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790156:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790199:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790206:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790227:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790233:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966953.790238:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790246:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790260:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966953.790263:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783966953.790268:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966953.790274:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067936 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966953.790446:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+40:12237:x1870624563738368:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 401us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966953.790455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:1.0:1783966953.797306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966953.797491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563738624 00000100:00100000:2.0:1783966953.797501:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563738624 00000100:00100000:2.0:1783966953.797605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1783966953.797616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+40:12237:x1870624563738624:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783966953.797933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:12237:x1870624563738624:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 318us (637us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783966953.797942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1783966953.850720:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587921536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966953.850821:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966953.850936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587921536 00000100:00100000:0.0:1783966953.850945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587921536 00000100:00100000:0.0:1783966953.850998:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783966953.851012:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587921536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783966953.851069:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783966953.851132:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587921536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966953.851140:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783966953.851365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587921536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966954.150629:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966954.150811:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563738880 00000100:00100000:1.0:1783966954.150822:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563738880 00000100:00100000:1.0:1783966954.150910:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:1.0:1783966954.150923:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:12268:x1870624563738880:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1783966954.150962:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966954.150984:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b31606793d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e4d expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.151117:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067944 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.151132:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.151146:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966954.151159:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783966954.151290:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b31606793d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e4d expref: 44 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.151310:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e4d expref: 43 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.151320:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966954.151323:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966954.151326:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e000, rc 0) 00000100:00100000:1.0:1783966954.151398:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12268:x1870624563738880:12345-192.168.204.59@tcp:101:cat.0 Request processed in 478us (780us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783966954.151406:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00080000:3.0:1783966954.151827:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966954.158101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966954.160904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966954.162072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563739264 00000100:00100000:1.0:1783966954.162085:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563739264 00000100:00100000:1.0:1783966954.162211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:1.0:1783966954.162223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12268:x1870624563739264:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:1.0:1783966954.162576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:12268:x1870624563739264:12345-192.168.204.59@tcp:35:cat.0 Request processed in 354us (1680us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1783966954.162597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1783966954.162657:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563739008 00000100:00100000:2.0:1783966954.162663:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563739008 00000100:00100000:2.0:1783966954.162702:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1783966954.162709:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:2400:x1870624563739008:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966954.162733:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966954.162758:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067944 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e4d expref: 44 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.162815:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966954.162820:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966954.162842:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:2400:x1870624563739008:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 133us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.162849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783966954.277450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966954.277657:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563739520 00000100:00100000:0.0:1783966954.277668:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563739520 00000100:00100000:0.0:1783966954.277736:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1783966954.277746:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12274:x1870624563739520:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:0.0:1783966954.277812:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966954.277827:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783966954.277854:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b3160678aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e23 expref: 43 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.277873:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966954.277878:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966954.277891:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067952 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.277993:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.278008:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.278017:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.278066:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.278082:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 43 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966954.278097:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587921664:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966954.278220:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966954.284456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966954.284562:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563739648 00000100:00100000:3.0:1783966954.284572:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563739648 00010000:00010000:3.0:1783966954.284612:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 44 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966954.284664:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1783966954.284675:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:2400:x1870624563739648:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966954.284690:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966954.284698:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 44 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.284713:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 44 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.284738:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966954.284744:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.284754:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.284761:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.284831:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966954.285011:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:2400:x1870624563739648:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 336us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966954.285020:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00010000:00010000:2.0:1783966954.285212:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067928 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e46 expref: 43 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966954.285230:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587921664:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966954.285264:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.285275:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.285282:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966954.285304:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783966954.285456:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067952 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.285481:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.285489:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966954.285492:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783966954.285494:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1200, rc 0) 00000100:00100000:2.0:1783966954.286076:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12274:x1870624563739520:12345-192.168.204.59@tcp:101:dd.0 Request processed in 8328us (8633us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783966954.286084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:0.0:1783966954.291559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966954.291739:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563739776 00000100:00100000:1.0:1783966954.291749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563739776 00000100:00100000:1.0:1783966954.291843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:1.0:1783966954.291854:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12274:x1870624563739776:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783966954.291891:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966954.291913:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067967 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e5b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.291947:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.291962:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.291973:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.292107:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067967 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.292123:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966954.292132:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966954.292135:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966954.292138:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ec00, rc 0) 00000100:00100000:1.0:1783966954.292206:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:12274:x1870624563739776:12345-192.168.204.59@tcp:101:dd.0 Request processed in 354us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966954.292219:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 169 00000100:00100000:1.0:1783966954.295331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966954.295425:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740032 00000100:00100000:0.0:1783966954.295450:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740032 00000100:00100000:0.0:1783966954.295533:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:0.0:1783966954.295545:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:12274:x1870624563740032:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:0.0:1783966954.295826:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.295845:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.295876:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966954.295920:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1783966954.295955:0:7847:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5fac4f0 reply state 00000000eba5250c transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.295968:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.295975:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966954.295978:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966954.295981:0:7847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966954.296081:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:12274:x1870624563740032:12345-192.168.204.59@tcp:36:dd.0 Request processed in 538us (761us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1783966954.296090:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00000020:00080000:0.0:1783966954.296095:0:7847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783966954.552102:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966954.718056:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.718343:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740160 00000100:00100000:2.0:1783966954.718354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740160 00000100:00100000:2.0:1783966954.718596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:2.0:1783966954.718608:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:12289:x1870624563740160:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:2.0:1783966954.718635:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966954.718656:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b31606797c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e62 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.718949:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.718964:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.718977:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.718991:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.719024:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.719031:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.719117:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.719130:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.719139:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.722975:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966954.723012:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 48 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966954.723032:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587921792:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966954.728978:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c82a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966954.733082:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c4c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587921792:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966954.733120:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966954.734958:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.735113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740416 00000100:00100000:2.0:1783966954.735124:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740416 00000100:00100000:2.0:1783966954.735197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1783966954.735208:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:6172:x1870624563740416:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783966954.735823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:6172:x1870624563740416:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 614us (872us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1783966954.735844:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1783966954.759017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759084:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740544 00000100:00100000:2.0:1783966954.759093:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740544 00000100:00100000:2.0:1783966954.759140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 392 00000100:00100000:2.0:1783966954.759150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563740544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.759228:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563740544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.759236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 392 00000100:00100000:2.0:1783966954.759284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759467:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740800 00000100:00100000:2.0:1783966954.759471:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740800 00000100:00100000:2.0:1783966954.759503:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740928 00000100:00100000:2.0:1783966954.759506:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740928 00000100:00100000:2.0:1783966954.759543:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1783966954.759550:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563740800:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.759583:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2403:x1870624563740800:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.759589:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1783966954.759602:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1783966954.759608:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563740928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.759647:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563740928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.759654:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1783966954.759677:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741056 00000100:00100000:2.0:1783966954.759681:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741056 00000100:00100000:2.0:1783966954.759705:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563740672 00000100:00100000:2.0:1783966954.759720:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563740672 00000100:00100000:2.0:1783966954.759741:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 339 00000100:00100000:2.0:1783966954.759748:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563741056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.759808:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563741056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 60us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.759815:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 339 00000100:00100000:2.0:1783966954.759828:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 340 00000100:00100000:2.0:1783966954.759834:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563740672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.759857:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563740672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.759865:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 340 00000100:00100000:2.0:1783966954.759902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966954.759985:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741184 00000100:00100000:2.0:1783966954.759989:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741184 00000100:00100000:2.0:1783966954.760009:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 341 00000100:00100000:2.0:1783966954.760015:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563741184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966954.760046:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563741184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966954.760054:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 341 00000100:00080000:3.0:1783966954.763253:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966954.763270:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966954.763275:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966954.763353:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741312 00000100:00100000:3.0:1783966954.763373:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741312 00010000:00010000:3.0:1783966954.764124:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 50 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966954.764189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1783966954.764203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c4c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:2401:x1870624563741312:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966954.764223:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966954.764237:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 50 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764253:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 50 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764285:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067959 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e54 expref: 50 pid: 6518 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764308:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966954.764334:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764346:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764357:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966954.764397:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966954.764479:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764506:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966954.764579:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783966954.764583:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966954.764607:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764624:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764635:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764640:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764647:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764653:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966954.764657:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764664:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764684:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966954.764722:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966954.764729:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764737:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067983 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764756:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764807:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764813:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764818:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966954.764821:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764827:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966954.764836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c4c70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+49:2401:x1870624563741312:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 569us (5771us total) trans 0 rc 0/0 00010000:00010000:0.0:1783966954.764850:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00000100:00100000:3.0:1783966954.764860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00010000:00010000:0.0:1783966954.764862:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966954.764870:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764877:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b31606798a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764930:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b31606797c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e62 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764960:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e62 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.764968:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966954.764970:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966954.764972:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:0.0:1783966954.765462:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+48:12289:x1870624563740160:12345-192.168.204.59@tcp:101:stat.0 Request processed in 46853us (47411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966954.765471:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 171 00000100:00100000:2.0:1783966954.840972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966954.841125:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741568 00000100:00100000:0.0:1783966954.841138:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741568 00000100:00100000:0.0:1783966954.841232:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:0.0:1783966954.841245:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+48:12295:x1870624563741568:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:0.0:1783966954.841338:0:10203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966954.841376:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067991 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e62 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.841399:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966954.841405:0:10203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966954.841639:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.841656:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.841666:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966954.841730:0:10203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1783966954.841751:0:10203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d330cbdd reply state 00000000eabdb461 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.841765:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966954.841836:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966954.841839:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966954.841842:0:10203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966954.842522:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:12295:x1870624563741568:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 1265us (1550us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1783966954.842535:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000020:00080000:0.0:1783966954.842543:0:10203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783966955.033514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.033962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741696 00000100:00100000:2.0:1783966955.033977:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741696 00000100:00100000:2.0:1783966955.034068:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:2.0:1783966955.034081:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+50:12309:x1870624563741696:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:2.0:1783966955.034117:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.034147:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606799f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e69 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034255:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034274:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034289:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034303:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034310:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034316:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034422:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034432:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034458:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966955.034748:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1783966955.034754:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966955.034840:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034856:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034866:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034874:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034882:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034888:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.034893:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034901:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034914:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966955.034917:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.034922:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034941:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034958:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034964:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034970:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034975:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.034978:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034984:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.034990:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00010000:00010000:2.0:1783966955.034993:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.034995:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.035001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.035033:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606799f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.035048:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.035061:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.035063:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966955.035066:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966955.035164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:12309:x1870624563741696:12345-192.168.204.59@tcp:101:stat.0 Request processed in 1084us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966955.035304:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 173 00000100:00100000:3.0:1783966955.154288:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.154482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563741952 00000100:00100000:0.0:1783966955.154656:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563741952 00000100:00100000:0.0:1783966955.154987:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:0.0:1783966955.155001:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+51:12319:x1870624563741952:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966955.155031:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966955.155062:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e70 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966955.155225:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783966955.155365:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e70 expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.155383:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:0.0:1783966955.155387:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966955.155412:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e70 expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.155431:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783966955.156115:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:12319:x1870624563741952:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1114us (1839us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1783966955.156125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:0.0:1783966955.161411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966955.163924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563742208 00000100:00100000:1.0:1783966955.163946:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563742208 00000100:00100000:1.0:1783966955.164255:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1783966955.164271:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:12319:x1870624563742208:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783966955.165030:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:12319:x1870624563742208:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 758us (3631us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1783966955.165041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1783966955.214259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.214444:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563742464 00000100:00100000:0.0:1783966955.214458:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563742464 00000100:00100000:0.0:1783966955.214540:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:0.0:1783966955.214553:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:12325:x1870624563742464:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966955.214601:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966955.214640:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e77 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.214872:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.214891:0:10203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.214902:0:10203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.214945:0:10203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.214960:0:10203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 54 pid: 6519 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966955.214987:0:10203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10203:1870624587921920:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966955.215132:0:10203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd480 going to sleep for 11 seconds 00000100:00100000:3.0:1783966955.222012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.222403:0:10203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10203:1870624587921920:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966955.222460:0:10203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966955.222531:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563742592 00000100:00100000:2.0:1783966955.222541:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563742592 00010000:00010000:2.0:1783966955.222594:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 55 pid: 6519 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966955.222714:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 86 00000100:00100000:2.0:1783966955.222726:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:2401:x1870624563742592:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966955.222746:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966955.222754:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 55 pid: 6519 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222820:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 55 pid: 6519 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222851:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b3160679b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e69 expref: 55 pid: 6519 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222870:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.222876:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222907:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222916:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.222941:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966955.223015:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:2401:x1870624563742592:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 290us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966955.223023:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 86 00010000:00010000:0.0:1783966955.223080:0:10203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.223088:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966955.223111:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1783966955.223303:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 55 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.223322:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 54 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.223331:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.223334:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783966955.223337:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0000, rc 0) 00000100:00100000:0.0:1783966955.223367:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:12325:x1870624563742464:12345-192.168.204.59@tcp:101:bash.0 Request processed in 8818us (9121us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1783966955.223375:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 175 00000100:00100000:0.0:1783966955.227202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966955.227415:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563742848 00000100:00100000:3.0:1783966955.227429:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563742848 00000100:00100000:3.0:1783966955.227502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:3.0:1783966955.227524:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:12325:x1870624563742848:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1783966955.227899:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.227922:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.227936:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783966955.227992:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1783966955.228016:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f147b3fd reply state 0000000047fec9d1 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.228038:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.228045:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966955.228047:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966955.228051:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783966955.228164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:12325:x1870624563742848:12345-192.168.204.59@tcp:36:bash.0 Request processed in 642us (992us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1783966955.228936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000020:00080000:3.0:1783966955.228943:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783966955.235213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.235317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563742976 00000100:00100000:2.0:1783966955.235330:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563742976 00000100:00100000:2.0:1783966955.235421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:2.0:1783966955.235436:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:12325:x1870624563742976:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966955.235496:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.235545:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e7e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.235707:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.235727:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 58 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.235738:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.235965:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 58 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.236003:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 58 pid: 10203 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966955.236020:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3718380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587922048:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966955.236143:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c82a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783966955.238993:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3718380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587922048:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966955.239040:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966955.247246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.249330:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563743104 00000100:00100000:2.0:1783966955.249350:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563743104 00010000:00010000:3.0:1783966955.253339:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 59 pid: 10203 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966955.253558:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 87 00000100:00100000:3.0:1783966955.253574:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:2401:x1870624563743104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966955.253607:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966955.253616:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 59 pid: 10203 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.253631:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 59 pid: 10203 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.253663:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b3160679d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e77 expref: 59 pid: 10203 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.253710:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966955.253717:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.253730:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.253739:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.255073:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966955.255344:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:2401:x1870624563743104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1767us (8108us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.255357:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 87 00010000:00010000:0.0:1783966955.255451:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.255462:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966955.255547:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783966955.255553:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966955.255592:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.255639:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b3160679e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e7e expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.255662:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e7e expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.255673:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.255676:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966955.255679:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:0.0:1783966955.255719:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c452fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:12325:x1870624563742976:12345-192.168.204.59@tcp:101:bash.0 Request processed in 20287us (20524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.255727:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 177 00000100:00100000:3.0:1783966955.261437:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.261748:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563743360 00000100:00100000:2.0:1783966955.261762:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563743360 00000100:00100000:2.0:1783966955.261977:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1783966955.261990:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+57:12325:x1870624563743360:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1783966955.262486:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12325:x1870624563743360:12345-192.168.204.59@tcp:35:bash.0 Request processed in 497us (1061us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1783966955.262496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:2.0:1783966955.384087:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966955.384122:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587922176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966955.384223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783966955.384549:0:9987:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431585777617ns, next at 432585773987ns, rc = 0 00000100:00100000:3.0:1783966955.384600:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966955.384612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587922304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966955.384663:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966955.384699:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922176 00000100:00100000:3.0:1783966955.384709:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922176 00000100:00100000:3.0:1783966955.384800:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922304 00000100:00100000:3.0:1783966955.384804:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922304 00000100:00100000:3.0:1783966955.384825:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783966955.384834:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587922176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966955.384874:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783966955.384922:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3718380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587922176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.384948:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783966955.384969:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783966955.384975:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587922304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783966955.384987:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783966955.385018:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587922304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.385024:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1783966955.385041:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783966955.385082:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3cf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587922304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966955.385122:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587922176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966955.385136:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966955.385147:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587922432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966955.385175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966955.385204:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922432 00000100:00100000:3.0:1783966955.385208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922432 00000100:00100000:3.0:1783966955.385229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783966955.385235:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587922432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966955.385251:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783966955.385281:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587922432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.385287:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1783966955.385300:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966955.385318:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587922432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966955.385517:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966955.385527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587922560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966955.385562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.385589:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922560 00000100:00100000:0.0:1783966955.385593:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922560 00000100:00100000:0.0:1783966955.385621:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783966955.385627:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587922560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966955.385660:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783966955.385691:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587922560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.385698:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783966955.385726:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587922560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783966955.385740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966955.386128:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587923072:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.386168:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966955.386188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587923584:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.386208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966955.386225:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783966955.386230:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587922944:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.386254:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966955.386268:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587923456:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.386287:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390160:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922944 00000100:00100000:0.0:1783966955.390185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922944 00000100:00100000:0.0:1783966955.390285:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783966955.390299:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587922944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587922944:12345-0@lo:400:kworker.0 Request processed in 153us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.390458:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783966955.390513:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587922816:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390565:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390610:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587923328:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390681:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783966955.390688:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587922688:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390747:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587923200:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390846:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587923712:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.390888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923200 00000100:00100000:0.0:1783966955.390909:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923200 00000100:00100000:0.0:1783966955.390932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783966955.390937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587923200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.390976:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587923200:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.390982:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1783966955.391020:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587923200:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391053:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923072 00000100:00100000:0.0:1783966955.391056:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923072 00000100:00100000:0.0:1783966955.391076:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923584 00000100:00100000:0.0:1783966955.391079:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923584 00000100:00100000:0.0:1783966955.391103:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923456 00000100:00100000:0.0:1783966955.391106:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923456 00000100:00100000:0.0:1783966955.391119:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922816 00000100:00100000:0.0:1783966955.391122:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922816 00000100:00100000:0.0:1783966955.391132:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923328 00000100:00100000:0.0:1783966955.391134:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923328 00000100:00100000:0.0:1783966955.391145:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923712 00000100:00100000:0.0:1783966955.391147:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923712 00000100:00100000:0.0:1783966955.391160:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783966955.391165:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587923072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391198:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587923072:12345-0@lo:400:kworker.0 Request processed in 33us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391205:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1783966955.391216:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1783966955.391221:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587923584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391247:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587923584:12345-0@lo:400:kworker.0 Request processed in 26us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391262:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1783966955.391274:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783966955.391279:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587923456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391308:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587923456:12345-0@lo:400:kworker.0 Request processed in 29us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391313:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1783966955.391324:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783966955.391329:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587922816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391357:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587922816:12345-0@lo:400:kworker.0 Request processed in 28us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391362:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1783966955.391372:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783966955.391378:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587923328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391404:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587923328:12345-0@lo:400:kworker.0 Request processed in 26us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391409:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1783966955.391432:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1783966955.391438:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587923712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391466:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587923712:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.391479:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:0.0:1783966955.391517:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966955.391522:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783966955.391543:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56aea00 x1870624587923712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966955.391573:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587923712:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391589:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587922816:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.391599:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587923328:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.392601:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587922688 00000100:00100000:1.0:1783966955.392613:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587922688 00000100:00100000:1.0:1783966955.392695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1783966955.392704:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587922688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.392847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587922688:12345-0@lo:400:kworker.0 Request processed in 144us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966955.392868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1783966955.392935:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587922944:0@lo:400:kworker.0 00010000:00080000:1.0:1783966955.392952:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf5c00 x1870624587923456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966955.392962:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587923456:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.392976:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587923072:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.392991:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587923584:0@lo:400:kworker.0 00000100:00100000:0.0:1783966955.393558:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587922688:0@lo:400:kworker.0 00000100:00100000:1.0:1783966955.405516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.405659:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563743616 00000100:00100000:0.0:1783966955.405673:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563743616 00000100:00100000:0.0:1783966955.405819:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:0.0:1783966955.405832:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12335:x1870624563743616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966955.405866:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966955.405895:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e85 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966955.406062:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1783966955.406237:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e85 expref: 60 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.406256:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:0.0:1783966955.406260:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966955.406266:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160679f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e85 expref: 60 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.406284:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783966955.406374:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:12335:x1870624563743616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 545us (886us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1783966955.406402:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 178 00000001:00080000:3.0:1783966955.410887:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00010000:00010000:0.0:1783966955.411101:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411126:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411136:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411144:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411149:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411158:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411190:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966955.411193:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411201:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411207:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b31606782c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411233:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411239:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411257:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411263:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411267:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411272:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411281:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966955.411284:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411288:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411293:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067833 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411313:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411319:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411325:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411329:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411332:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411347:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411355:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca600) 00010000:00010000:0.0:1783966955.411357:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411361:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411367:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067872 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411383:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411401:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411407:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411412:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411414:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411420:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411427:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.411429:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411432:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411448:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067975 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411460:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411466:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411471:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411476:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411479:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411484:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411492:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.411494:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411497:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411512:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067998 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411522:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411530:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411541:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411547:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.411550:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411557:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411565:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.411568:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.411571:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.411577:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b3160679de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783966955.411757:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1783966955.411846:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1783966955.411858:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a04c35a8d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1783966955.411863:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c35a86c0 00000020:00080000:3.0:1783966955.411866:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c35d2e00 00000020:00080000:2.0:1783966955.411941:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783966955.412037:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783966955.412626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587923840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783966955.412732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966955.413294:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923840 00000100:00100000:0.0:1783966955.413306:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923840 00000100:00100000:0.0:1783966955.413377:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783966955.413463:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587923840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783966955.413515:0:14225:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1783966955.413565:0:14225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a552ce8, atime: 0x6a552ce8, ctime: 0x6a552ce8, blocks: 0x8 00010000:00010000:0.0:1783966955.413575:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.413597:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1783966955.413602:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966955.413621:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.414100:0:14225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.414117:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.414126:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.414208:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783966955.414463:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3646:x1870624587923840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1075us (1730us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783966955.414474:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:2.0:1783966955.416397:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3ea4000/2, rc 0, transno 4294967308 00000100:00100000:2.0:1783966955.416420:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587923840:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783966955.419317:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966955.419338:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.419356:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783966955.419362:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.419375:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.419413:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.419422:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316067a01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.419468:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966955.419470:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966955.419472:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966955.419710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.420040:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563743744 00000100:00100000:0.0:1783966955.420054:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563743744 00000100:00100000:0.0:1783966955.420178:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:0.0:1783966955.420192:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:12335:x1870624563743744:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1783966955.420295:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420315:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420329:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420373:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420381:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420529:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420651:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420662:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420670:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966955.420733:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420750:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420916:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420925:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420932:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.420938:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420954:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420966:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966955.420970:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.420975:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420983:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067a08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.420998:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421005:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421012:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421017:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.421019:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421025:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421032:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4100) 00010000:00010000:0.0:1783966955.421034:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.421036:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421053:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067a0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421070:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421076:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421082:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421087:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.421090:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421095:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421104:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.421106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966955.421109:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.421115:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966955.421225:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:12335:x1870624563743744:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1035us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.421235:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 179 00000100:00100000:1.0:1783966955.425143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.425319:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563744000 00000100:00100000:2.0:1783966955.425334:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563744000 00000100:00100000:2.0:1783966955.425474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:2.0:1783966955.425487:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+17:12335:x1870624563744000:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783966955.426054:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:12335:x1870624563744000:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 567us (924us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783966955.426063:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1783966955.485331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966955.485540:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563744256 00000100:00100000:3.0:1783966955.485555:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563744256 00000100:00100000:3.0:1783966955.485681:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:3.0:1783966955.485694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:12338:x1870624563744256:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966955.485750:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.488097:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488249:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488267:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488284:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488312:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488319:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488945:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067a32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488960:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.488969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067a32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966955.488981:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783966955.489089:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489097:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489105:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489111:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.489116:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489124:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489139:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966955.489142:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.489147:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489231:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a24 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489248:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489255:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489262:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489268:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.489272:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489279:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1ccaf00) 00010000:00010000:2.0:1783966955.489291:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.489294:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489300:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489367:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e8c expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489451:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067a32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e8c expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.489468:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.489470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966955.489473:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631000, rc 0) 00000100:00100000:2.0:1783966955.489967:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12338:x1870624563744256:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 4271us (4650us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783966955.489978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 180 00000100:00100000:1.0:1783966955.500131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966955.500195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966955.500276:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563744512 00000100:00100000:0.0:1783966955.500291:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563744512 00000100:00100000:0.0:1783966955.500370:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:0.0:1783966955.500391:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12338:x1870624563744512:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1783966955.500492:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500524:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500539:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500588:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500596:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500603:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500610:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966955.500616:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500624:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500640:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:0.0:1783966955.500644:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966955.500669:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966955.500677:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067a40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966955.500809:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12338:x1870624563744512:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 385us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966955.500817:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 181 00000100:00100000:3.0:1783966955.502472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563744384 00000100:00100000:3.0:1783966955.502488:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563744384 00000100:00100000:3.0:1783966955.502645:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783966955.502657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:2401:x1870624563744384:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966955.502679:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966955.502709:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067a32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e8c expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.502733:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:3.0:1783966955.502739:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966955.502859:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:2401:x1870624563744384:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 204us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.502867:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783966955.507659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966955.507833:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563744768 00000100:00100000:3.0:1783966955.507847:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563744768 00000100:00100000:3.0:1783966955.507909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:3.0:1783966955.507920:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:12338:x1870624563744768:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783966955.508253:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12338:x1870624563744768:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 333us (613us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783966955.508262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00010000:00010000:2.0:1783966955.575753:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966955.659750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.660225:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745024 00000100:00100000:2.0:1783966955.660238:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745024 00000100:00100000:2.0:1783966955.660347:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:2.0:1783966955.660360:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12356:x1870624563745024:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1783966955.660405:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.660434:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e93 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.660606:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.660632:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.660648:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966955.660663:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783966955.661182:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e93 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.661232:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e93 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.661242:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.661246:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783966955.661250:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630e00, rc 0) 00000100:00100000:2.0:1783966955.661376:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12356:x1870624563745024:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1017us (1644us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783966955.661393:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 182 00000100:00100000:0.0:1783966955.693225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.694048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745152 00000100:00100000:2.0:1783966955.694247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745152 00000100:00100000:2.0:1783966955.694334:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:2.0:1783966955.694345:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12357:x1870624563745152:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966955.694379:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.694408:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6e9a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694676:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694717:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966955.694808:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1783966955.694830:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966955.694856:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694886:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e9a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694907:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e9a expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.694917:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966955.694921:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966955.694924:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783966955.695040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12357:x1870624563745152:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 697us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966955.695047:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 183 00000100:00100000:1.0:1783966955.705606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966955.705856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745536 00000100:00100000:3.0:1783966955.705870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745536 00000100:00100000:3.0:1783966955.705947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1783966955.705962:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12357:x1870624563745536:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783966955.706698:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12357:x1870624563745536:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 736us (1106us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1783966955.706710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:0.0:1783966955.709619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.709755:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745664 00000100:00100000:2.0:1783966955.709807:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745664 00000100:00100000:2.0:1783966955.709904:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783966955.709917:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12357:x1870624563745664:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:2.0:1783966955.709938:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783966955.709972:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b3160679ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e7e expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.709999:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e93 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.710012:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b3160678e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e38 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.710048:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.710056:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966955.710142:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12357:x1870624563745664:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 227us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966955.710151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1783966955.713681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966955.713949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745792 00000100:00100000:3.0:1783966955.713962:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745792 00000100:00100000:3.0:1783966955.714080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:3.0:1783966955.714094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12357:x1870624563745792:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:3.0:1783966955.714278:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.714300:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966955.714315:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783966955.714469:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783966955.714634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12357:x1870624563745792:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 541us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.714643:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 184 00000100:00100000:1.0:1783966955.736051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966955.736338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563745920 00000100:00100000:2.0:1783966955.736353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563745920 00000100:00100000:2.0:1783966955.736449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:2.0:1783966955.736464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12359:x1870624563745920:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966955.736508:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966955.736540:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ea1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736675:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736696:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736712:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736731:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736738:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.736756:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737149:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737240:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737249:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966955.737312:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783966955.737317:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966955.737342:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737368:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737434:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737444:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737452:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.737458:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737477:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737505:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966955.737509:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.737515:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737522:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737542:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737548:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737556:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737562:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966955.737566:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737572:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737581:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1ccaf00) 00010000:00010000:2.0:1783966955.737583:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966955.737586:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.737602:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.741315:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067a71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.741360:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966955.741373:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966955.741376:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966955.742883:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:2.0:1783966955.743016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12359:x1870624563745920:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 6549us (6976us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966955.743028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 185 00000100:00100000:2.0:1783966955.902185:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966955.902229:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587923968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966955.902349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966955.902621:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587923968 00000100:00100000:3.0:1783966955.902632:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587923968 00000100:00100000:3.0:1783966955.902701:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783966955.902714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f15e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587923968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966955.902807:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783966955.902880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f15e1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587923968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966955.902888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783966955.903354:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587923968:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783966956.470951:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966956.470964:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966956.470996:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783966956.471003:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966956.471208:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c371b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587924096:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783966956.471341:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783966956.478073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.478873:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c371b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587924096:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783966956.482672:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563746048 00000100:00100000:0.0:1783966956.482698:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563746048 00000100:00080000:3.0:1783966956.482816:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966956.482852:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:0.0:1783966956.482869:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12370:x1870624563746048:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783966956.482914:0:6519:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783966956.483081:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12370:x1870624563746048:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 217us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.483091:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 186 00000100:00100000:2.0:1783966956.487571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.487636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563746176 00000100:00100000:2.0:1783966956.487649:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563746176 00000100:00100000:2.0:1783966956.487731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:2.0:1783966956.487744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12370:x1870624563746176:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783966956.487874:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487896:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487919:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487940:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487947:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487954:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.487993:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488004:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488012:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966956.488073:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783966956.488086:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966956.488105:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488120:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488127:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488136:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488144:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966956.488149:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488157:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488173:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:2.0:1783966956.488176:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966956.488183:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488195:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067a8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488215:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488221:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488238:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488243:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966956.488246:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488252:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488261:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9a04c1ccaf00) 00010000:00010000:2.0:1783966956.488263:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966956.488267:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488273:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067a94 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488289:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488295:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488301:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488306:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966956.488309:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488323:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488332:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966956.488334:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966956.488337:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.488343:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067a9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966956.489747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12370:x1870624563746176:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 1992us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966956.489762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 187 00000100:00100000:1.0:1783966956.495661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.495766:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563746432 00000100:00100000:2.0:1783966956.495885:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563746432 00000100:00100000:2.0:1783966956.496008:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:2.0:1783966956.496022:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12370:x1870624563746432:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966956.496050:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966956.496077:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067aa2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ea8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496422:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496442:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496460:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966956.496505:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783966956.496624:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496633:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496640:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496647:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966956.496651:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496661:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496676:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966956.496679:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966956.496685:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496692:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067aa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496746:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067aa2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea8 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496757:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:2.0:1783966956.496760:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783966956.496813:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067aa2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea8 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.496825:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966956.496912:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563746432:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 892us (1265us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1783966956.496920:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 188 00000100:00100000:3.0:1783966956.507512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.507694:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563746560 00000100:00100000:1.0:1783966956.507711:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563746560 00000100:00100000:1.0:1783966956.507824:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:1.0:1783966956.507839:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563746560:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783966956.507891:0:7847:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783966956.508052:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563746560:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 216us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.508079:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 189 00000100:00100000:3.0:1783966956.515905:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.516040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563746816 00000100:00100000:0.0:1783966956.516053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563746816 00000100:00100000:0.0:1783966956.516674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:0.0:1783966956.516688:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563746816:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966956.516719:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966956.516723:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783966956.516761:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067a63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e9a expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.517244:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966956.517251:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966956.517272:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067ab7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6eaf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783966956.519927:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783966956.520214:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067abe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.520236:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.520251:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067abe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.520350:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067ab7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eaf expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.520369:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067abe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eaf expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.520379:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4100) 00010000:00010000:0.0:1783966956.520383:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966956.520388:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783966956.520528:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12370:x1870624563746816:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3842us (4638us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1783966956.520538:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 190 00000100:00100000:2.0:1783966956.531594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.536050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747072 00000100:00100000:0.0:1783966956.536074:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747072 00000100:00100000:1.0:1783966956.536834:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:1.0:1783966956.536850:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12370:x1870624563747072:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.536936:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966956.536976:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067abe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eaf expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537001:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4100) 00010000:00010000:1.0:1783966956.537025:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783966956.537058:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537076:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537102:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537119:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537127:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537134:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537205:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537230:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537237:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537243:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.537249:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537257:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537267:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966956.537270:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966956.537275:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067acc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537291:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537297:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537303:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537308:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.537319:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537327:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb6013973 (ffff9a05f1a82a00) 00010000:00010000:1.0:1783966956.537338:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966956.537341:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.537347:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067ad3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb6013973 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.537619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563747072:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 772us (6039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783966956.537628:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 191 00000100:00100000:3.0:1783966956.543883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.544079:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747200 00000100:00100000:0.0:1783966956.544094:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747200 00000100:00100000:0.0:1783966956.544180:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:0.0:1783966956.544194:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563747200:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966956.544225:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966956.544259:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067ada lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6eb6 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544311:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544329:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544345:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544524:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 25 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544548:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.544557:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966956.544561:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966956.544565:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0600, rc 0) 00000100:00100000:0.0:1783966956.545750:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12370:x1870624563747200:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1356us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.545801:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 192 00000100:00100000:2.0:1783966956.555906:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.556971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747456 00000100:00100000:0.0:1783966956.556991:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747456 00000100:00100000:0.0:1783966956.557156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:0.0:1783966956.557171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12370:x1870624563747456:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783966956.557298:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.557318:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.557334:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783966956.557581:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1783966956.557594:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432758823934ns, next at 433758820294ns, rc = 0 00000004:00010000:0.0:1783966956.557662:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004cd40898 reply state 000000008c10983f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.557680:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.557691:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966956.557694:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783966956.557699:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966956.560693:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12370:x1870624563747456:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 3508us (4787us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783966956.560711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 193 00000100:00100000:3.0:1783966956.563674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.569239:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747584 00000100:00100000:1.0:1783966956.569264:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747584 00000100:00100000:1.0:1783966956.571222:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:1.0:1783966956.571251:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12370:x1870624563747584:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.571309:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966956.571342:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ebd expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.571455:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.571474:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.571526:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:1.0:1783966956.571530:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966956.571534:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fa00, rc 0) 00000100:00100000:1.0:1783966956.571625:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12370:x1870624563747584:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 387us (7965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.571634:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 194 00000100:00100000:2.0:1783966956.580676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966956.580923:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747712 00000100:00100000:3.0:1783966956.580936:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747712 00000100:00100000:3.0:1783966956.581035:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1783966956.581048:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+6:2400:x1870624563747712:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783966956.581362:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563747712:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 316us (704us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783966956.581371:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00080000:2.0:1783966956.581877:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966956.599979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.600042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563747968 00000100:00100000:0.0:1783966956.600079:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563747968 00000100:00100000:0.0:1783966956.600176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00010000:00010000:3.0:1783966956.600192:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966956.600192:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12370:x1870624563747968:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783966956.600457:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12370:x1870624563747968:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 270us (496us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1783966956.600466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1783966956.603191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.603270:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748224 00000100:00100000:0.0:1783966956.603285:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748224 00000100:00100000:0.0:1783966956.603375:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:0.0:1783966956.603387:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12370:x1870624563748224:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783966956.603541:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12370:x1870624563748224:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 156us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.603549:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 195 00000100:00100000:2.0:1783966956.608585:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.608685:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748352 00000100:00100000:1.0:1783966956.608695:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748352 00000100:00100000:1.0:1783966956.608764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:1.0:1783966956.608800:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12370:x1870624563748352:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.608821:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966956.608854:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067af6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ec4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.608928:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.608943:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.608955:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966956.609007:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966956.609027:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.609052:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067af6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ec4 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.609085:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ec4 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.609094:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:1.0:1783966956.609097:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783966956.609100:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f800, rc 0) 00000100:00100000:1.0:1783966956.609161:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12370:x1870624563748352:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 364us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.609168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 196 00000100:00100000:2.0:1783966956.612593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.612699:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748480 00000100:00100000:0.0:1783966956.612712:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748480 00000100:00100000:0.0:1783966956.612806:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1783966956.612818:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563748480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966956.612844:0:8714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966956.612866:0:8714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ecb expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783966956.612901:0:8714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552ceb, blocks: 0x0 00010000:00010000:0.0:1783966956.612922:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1783966956.612927:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966956.612937:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 8 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.612971:0:8714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 8 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.612985:0:8714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1000, rc 0) 00000100:00100000:0.0:1783966956.613046:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c371b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563748480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 230us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.613053:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1783966956.626215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.626303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748736 00000100:00100000:1.0:1783966956.626318:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748736 00000100:00100000:1.0:1783966956.626412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:1.0:1783966956.626424:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12370:x1870624563748736:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783966956.626560:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12370:x1870624563748736:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.626569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 197 00000100:00100000:1.0:1783966956.639630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966956.639712:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748864 00000100:00100000:3.0:1783966956.639729:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748864 00000100:00100000:3.0:1783966956.639825:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1783966956.639836:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:12370:x1870624563748864:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966956.639860:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966956.639885:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ed2 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.639927:0:14225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.639951:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966956.639956:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783966956.639963:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.640012:0:14225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.640029:0:14225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966956.640046:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14225:1870624587924224:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783966956.641865:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966956.650398:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14225:1870624587924224:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966956.650447:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.650476:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:0.0:1783966956.650575:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:12370:x1870624563748864:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 10739us (10954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.650585:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1783966956.655563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.655681:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563748992 00000100:00100000:2.0:1783966956.655700:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563748992 00010000:00010000:2.0:1783966956.655758:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966956.655830:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:2.0:1783966956.655843:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563748992:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966956.655862:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966956.655892:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.655907:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.655959:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c923b046/0x9269c8b316067b04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ecb expref: 9 pid: 8714 timeout: 532 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.655981:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966956.655986:0:13736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966956.655996:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.656009:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.656062:0:13736:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966956.656082:0:13736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13736:1870624587924352:192.168.204.59@tcp:105: 00000100:00100000:2.0:1783966956.656276:0:13736:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9240 going to sleep for 11 seconds 00000100:00100000:3.0:1783966956.665636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.665717:0:13736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13736:1870624587924352:192.168.204.59@tcp:105: 00010000:00010000:1.0:1783966956.665747:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966956.669889:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563749120 00000100:00100000:2.0:1783966956.669912:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563749120 00002000:00100000:2.0:1783966956.669995:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a04c2748700 x1870624563749120/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:117/0 lens 504/0 e 0 to 0 dl 1783966967 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783966956.670008:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c2748700 with x1870624563749120 ext(0->8) 00002000:00010000:2.0:1783966956.670016:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c2748700 00000100:00100000:2.0:1783966956.670053:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783966956.670065:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563749120:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783966956.674851:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2401:x1870624563749120:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 4770us (9214us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783966956.674870:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00002000:00100000:2.0:1783966956.674889:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a04c2748700 x1870624563749120/t4294967315(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:117/0 lens 504/448 e 0 to 0 dl 1783966967 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783966956.674900:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c2748700 with x1870624563749120 ext(0->8) 00002000:00010000:2.0:1783966956.674907:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c2748700 00000100:00100000:1.0:1783966956.678098:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2400:x1870624563748992:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 22243us (22537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.678115:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 88 00000100:00100000:3.0:1783966956.685374:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.685639:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563749248 00000100:00100000:1.0:1783966956.685843:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563749248 00000100:00100000:1.0:1783966956.686020:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 198 00000100:00100000:1.0:1783966956.686031:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12370:x1870624563749248:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783966956.694839:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1783966956.694866:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1783966956.694920:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1783966956.694945:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1783966956.694959:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783966956.695334:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966956.695365:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587924480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783966956.695443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966956.695625:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12370:x1870624563749248:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 9589us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.695638:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 198 00010000:00010000:3.0:1783966956.696293:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696308:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696318:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696325:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966956.696351:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696360:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696384:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:3.0:1783966956.696388:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783966956.696394:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966956.696401:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067ae8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966956.697011:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587924480 00000100:00100000:0.0:1783966956.697025:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587924480 00000100:00100000:0.0:1783966956.697112:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783966956.697124:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587924480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783966956.697315:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783966956.697319:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783966956 00002000:00010000:0.0:1783966956.697331:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783966956.697333:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783966955 -> 1783966956 00002000:00010000:0.0:1783966956.697335:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783966956.697423:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587924480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 301us (1979us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783966956.697431:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1783966956.697512:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c1cf4a80/2, rc 0, transno 4294967316 00000100:00100000:0.0:1783966956.697520:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587924480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783966956.703256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.703419:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563749376 00000100:00100000:0.0:1783966956.703438:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563749376 00000100:00100000:0.0:1783966956.703530:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783966956.703542:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2401:x1870624563749376:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783966956.710235:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1783966956.710253:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1783966956.710660:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563749376:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 7110us (7411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.710676:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1783966956.714115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.714368:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563749632 00000100:00100000:2.0:1783966956.714382:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563749632 00000100:00100000:2.0:1783966956.714465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:2.0:1783966956.714491:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:12370:x1870624563749632:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783966956.714569:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966956.714611:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067afd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ec4 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.714649:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:2.0:1783966956.714656:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966956.714701:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.714718:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.714749:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966956.714951:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000072fa5c8e reply state 00000000d30c3882 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.714966:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.714973:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:2.0:1783966956.714976:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966956.714979:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966956.715128:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12370:x1870624563749632:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 651us (1027us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1783966956.715137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 199 00000100:00100000:3.0:1783966956.721090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.721268:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563749760 00000100:00100000:2.0:1783966956.721282:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563749760 00000100:00100000:2.0:1783966956.721372:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1783966956.721385:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563749760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783966956.721637:0:14225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783966956.721641:0:14225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783966956 -> 1783966954 00002000:00010000:2.0:1783966956.721644:0:14225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783966952 00002000:00010000:2.0:1783966956.721647:0:14225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783966956 -> 1783966954 00002000:00010000:2.0:1783966956.721649:0:14225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783966956.721737:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563749760:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 354us (661us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783966956.721745:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:3.0:1783966956.730169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.731265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750016 00000100:00100000:1.0:1783966956.731281:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750016 00000100:00100000:1.0:1783966956.731382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:1.0:1783966956.731394:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:12370:x1870624563750016:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.731527:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.731550:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 20 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.731575:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.731629:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 20 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.731669:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 20 pid: 10203 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.731688:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587924608:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966956.731858:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9900 going to sleep for 11 seconds 00000100:00100000:2.0:1783966956.745144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.745193:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750144 00000100:00100000:2.0:1783966956.745216:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750144 00010000:00010000:2.0:1783966956.745267:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 21 pid: 10203 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966956.745314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 89 00000100:00100000:2.0:1783966956.745324:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:2400:x1870624563750144:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966956.745343:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966956.745350:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 21 pid: 10203 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.745366:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 21 pid: 10203 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.745398:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:2.0:1783966956.745406:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.745420:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.745429:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.745454:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966956.745540:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:2400:x1870624563750144:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 216us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966956.745550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 89 00010000:00010000:1.0:1783966956.745644:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067ae1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eb6 expref: 20 pid: 10203 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.745662:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587924608:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966956.745690:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745701:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745708:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745765:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745802:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745810:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745817:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.745831:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745839:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745850:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:1.0:1783966956.745853:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783966956.745857:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.745864:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067b19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.745912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:12370:x1870624563750016:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 14520us (15770us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783966956.745920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 200 00000100:00100000:3.0:1783966956.749540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.749630:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750272 00000100:00100000:1.0:1783966956.749643:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750272 00000100:00100000:1.0:1783966956.749714:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:1.0:1783966956.749727:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2403:x1870624563750272:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.749818:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.749845:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.749855:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966956.749861:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783966956.749875:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.749923:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.749941:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 8 pid: 14225 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.749960:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587924736:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966956.750075:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9900 going to sleep for 11 seconds 00000100:00100000:1.0:1783966956.754043:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587924736:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966956.754086:0:8714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966956.760600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.760702:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750400 00000100:00100000:0.0:1783966956.760716:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750400 00010000:00010000:0.0:1783966956.760822:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966956.760875:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 90 00000100:00100000:0.0:1783966956.760887:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563750400:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966956.760908:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966956.760938:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.760955:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.761008:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b316067b0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed2 expref: 9 pid: 14225 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.761034:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966956.761041:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783966956.761050:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.761065:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.761121:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966956.761238:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563750400:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 352us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966956.761248:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 90 00010000:00010000:1.0:1783966956.761354:0:8714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761366:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761394:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761403:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761425:0:8714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761433:0:8714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966956.761439:0:8714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761450:0:8714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761465:0:8714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.761473:0:8714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067b20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.761542:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563750272:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 11818us (12017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.761551:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:3.0:1783966956.769029:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.769153:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750656 00000100:00100000:1.0:1783966956.769165:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750656 00000100:00100000:1.0:1783966956.769242:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 201 00000100:00100000:1.0:1783966956.769254:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:12370:x1870624563750656:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783966956.769381:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.769417:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.769430:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.769491:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.769509:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 19 pid: 6519 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.769528:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587924864:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966956.769642:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0da9900 going to sleep for 11 seconds 00000100:00100000:3.0:1783966956.772902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.773815:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587924864:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966956.773856:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.773967:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750784 00000100:00100000:1.0:1783966956.773978:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750784 00010000:00010000:1.0:1783966956.774039:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 20 pid: 6519 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.774093:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 91 00000100:00100000:1.0:1783966956.774104:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:2400:x1870624563750784:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966956.774126:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966956.774135:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 20 pid: 6519 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774160:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 20 pid: 6519 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774204:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b31606796e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e5b expref: 20 pid: 6519 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774223:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966956.774229:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774243:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774252:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.774286:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966956.775133:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.775154:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.775653:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:2400:x1870624563750784:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 255us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.775672:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 91 00010000:00010000:0.0:1783966956.775896:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.775920:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.775931:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.775973:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 19 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.775991:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 19 pid: 7847 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966956.776008:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587924992:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966956.776108:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783966956.780765:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587924992:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966956.780862:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966956.781699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966956.794699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563750912 00000100:00100000:0.0:1783966956.794721:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563750912 00010000:00010000:0.0:1783966956.794809:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 20 pid: 7847 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966956.794863:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:0.0:1783966956.794874:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:2401:x1870624563750912:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966956.794894:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966956.794922:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 20 pid: 7847 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795048:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 20 pid: 7847 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795081:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067aef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ebd expref: 20 pid: 7847 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795101:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966956.795108:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795121:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795130:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795264:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966956.795303:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966956.795311:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.795892:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:2401:x1870624563750912:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1014us (14194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.795903:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000001:00080000:0.0:1783966956.797082:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1783966956.797324:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1783966956.797374:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1783966956.797494:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7847:1870624587925120:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783966956.797738:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966956.797912:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd240 going to sleep for 11 seconds 00000100:00100000:1.0:1783966956.798278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587925120 00000100:00100000:1.0:1783966956.798290:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587925120 00000100:00100000:1.0:1783966956.798372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783966956.798383:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7847:x1870624587925120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783966956.798529:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7847:x1870624587925120:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966956.798538:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783966956.805126:0:7847:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1783966956.805155:0:7847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c1cf4a80, transno 4294967316 00000100:00100000:1.0:1783966956.805187:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7847:1870624587925120:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1783966956.805431:0:7847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1783966956.805553:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7847:1870624587925248:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783966956.805643:0:7847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966956.805694:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783966956.805727:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587925248 00000100:00100000:1.0:1783966956.805735:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587925248 00000100:00100000:1.0:1783966956.805812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783966956.805823:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7847:x1870624587925248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783966956.806257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7847:x1870624587925248:12345-0@lo:1000:mdt00_003.0 Request processed in 434us (613us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783966956.806266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1783966956.806320:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7847:1870624587925248:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783966956.806438:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806450:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806458:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806464:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.806471:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806490:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806531:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:1.0:1783966956.806534:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966956.806540:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806546:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067b2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806575:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.806582:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807484:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807493:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.807497:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807507:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807521:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966956.807524:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966956.807529:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807537:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067a6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807608:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807628:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807638:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807688:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.807710:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 22 pid: 6518 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.807725:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587925376:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966956.807862:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783966956.825170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966956.825286:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563751040 00000100:00100000:2.0:1783966956.825299:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563751040 00010000:00010000:2.0:1783966956.825377:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 23 pid: 6518 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966956.825438:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:2.0:1783966956.825450:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:2401:x1870624563751040:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966956.825469:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966956.825487:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 23 pid: 6518 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.825502:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 23 pid: 6518 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.825534:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:2.0:1783966956.825541:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.825554:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.825563:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966956.825588:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966956.825679:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:2401:x1870624563751040:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 230us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966956.825688:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00010000:00010000:1.0:1783966956.826386:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067a86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ea1 expref: 22 pid: 6518 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.826412:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587925376:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966956.826439:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826450:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826457:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826497:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826505:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826513:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826520:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.826526:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826534:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826549:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966956.826552:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966956.826556:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826563:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067b35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826574:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826580:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826586:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826597:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966956.826601:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826607:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826617:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4a00) 00010000:00010000:1.0:1783966956.826619:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966956.826622:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.826628:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b27 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966956.826866:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12370:x1870624563750656:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 57613us (57853us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1783966956.826878:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 201 00000020:00080000:1.0:1783966956.826883:0:7847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783966956.827683:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966956.827691:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966956.829235:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1783966956.829300:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783966956.839208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966956.841897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563751296 00000100:00100000:1.0:1783966956.841922:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563751296 00000100:00100000:1.0:1783966956.842008:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1783966956.842022:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12370:x1870624563751296:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783966956.842405:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783966956.842452:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1783966956.842508:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842559:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842571:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842579:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842585:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842616:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783966956.842757:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12370:x1870624563751296:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 736us (3561us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1783966956.842767:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000020:00080000:1.0:1783966956.842811:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783966956.842899:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966956.842908:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842916:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966956.842921:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842931:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842947:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:1.0:1783966956.842950:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783966956.842963:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842970:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067b3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966956.842983:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966956.842984:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966956.842986:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966956.881764:0:14659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966956.882734:0:14659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966956.883075:0:14659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783966956.883082:0:14659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783966957.035865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966957.035949:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563751552 00000100:00100000:3.0:1783966957.035959:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563751552 00000100:00100000:3.0:1783966957.036008:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:3.0:1783966957.036017:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:12380:x1870624563751552:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966957.036042:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966957.036064:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ed9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.036176:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067b4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.036200:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067b4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.036213:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067b4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966957.036225:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783966957.036328:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed9 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.036347:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067b4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed9 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.036356:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966957.036359:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783966957.036362:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0a00, rc 0) 00000100:00100000:3.0:1783966957.036434:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:12380:x1870624563751552:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 417us (578us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783966957.036440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 202 00000100:00100000:1.0:1783966957.042540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.042688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563751680 00000100:00100000:0.0:1783966957.042699:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563751680 00000100:00100000:0.0:1783966957.042758:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:0.0:1783966957.042797:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:12380:x1870624563751680:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1783966957.042875:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.042893:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.042905:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.042920:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.042927:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.042933:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043015:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043024:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043031:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966957.043090:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043102:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043108:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043115:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043121:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.043125:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043144:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043160:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966957.043163:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.043168:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043175:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043188:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043194:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043207:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043211:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.043214:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043219:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043228:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4c00) 00010000:00010000:0.0:1783966957.043230:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.043233:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043237:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043251:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043257:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043263:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043268:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.043270:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043289:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043296:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966957.043299:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.043301:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.043307:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966957.043391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:12380:x1870624563751680:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 622us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.043401:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 203 00000100:00100000:1.0:1783966957.095466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966957.096818:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563751936 00000100:00100000:3.0:1783966957.096832:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563751936 00000100:00100000:3.0:1783966957.096924:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:3.0:1783966957.096937:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+25:12383:x1870624563751936:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966957.096961:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966957.096986:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067b6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ee0 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097119:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097137:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097149:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097163:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097170:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097176:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097312:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097321:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097329:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966957.097339:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783966957.097419:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097426:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097439:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097445:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966957.097449:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097456:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097480:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966957.097483:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966957.097488:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097494:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067b74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097509:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097516:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097522:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097526:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966957.097529:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097545:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097554:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c3424800) 00010000:00010000:3.0:1783966957.097556:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966957.097559:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097566:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097609:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067b6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 28 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097623:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.097630:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:3.0:1783966957.097632:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966957.097634:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179400, rc 0) 00000100:00100000:3.0:1783966957.097703:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12383:x1870624563751936:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 769us (2249us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1783966957.097711:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 204 00000100:00100000:1.0:1783966957.102367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.102458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563752064 00000100:00100000:0.0:1783966957.102478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563752064 00000100:00100000:0.0:1783966957.102543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:0.0:1783966957.102554:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12383:x1870624563752064:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1783966957.102641:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102661:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102675:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102719:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102744:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102751:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102757:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.102761:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102802:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102818:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.102821:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966957.102826:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.102832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966957.103097:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12383:x1870624563752064:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 542us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.103450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 205 00000100:00100000:1.0:1783966957.105312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.107649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563752320 00000100:00100000:0.0:1783966957.107664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563752320 00000100:00100000:0.0:1783966957.107734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:0.0:1783966957.107746:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12383:x1870624563752320:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783966957.108290:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12383:x1870624563752320:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 543us (2983us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1783966957.108308:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1783966957.151718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.151910:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563752576 00000100:00100000:0.0:1783966957.151927:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563752576 00000100:00100000:0.0:1783966957.151998:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:0.0:1783966957.152009:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:11915:x1870624563752576:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966957.152034:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966957.152059:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b97 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ee7 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.152338:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.152354:0:10203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 29 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.152364:0:10203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.152401:0:10203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 29 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.152418:0:10203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 29 pid: 7847 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966957.152431:0:10203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10203:1870624587925504:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966957.152548:0:10203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd300 going to sleep for 11 seconds 00000100:00100000:3.0:1783966957.155626:0:10203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10203:1870624587925504:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783966957.155693:0:10203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966957.156709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.157524:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563752704 00000100:00100000:0.0:1783966957.157551:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563752704 00010000:00010000:0.0:1783966957.157599:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 30 pid: 7847 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966957.157639:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:0.0:1783966957.157650:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:2401:x1870624563752704:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966957.157667:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966957.157674:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 30 pid: 7847 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157687:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 30 pid: 7847 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157711:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee0 expref: 30 pid: 7847 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157726:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.157732:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157741:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157747:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.157805:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966957.157862:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:2401:x1870624563752704:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 212us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.157878:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00010000:00010000:1.0:1783966957.159029:0:10203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.159043:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966957.159067:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783966957.159552:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067b97 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 30 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.159574:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 29 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.159584:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:1.0:1783966957.159587:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783966957.159590:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:1.0:1783966957.159670:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:11915:x1870624563752576:12345-192.168.204.59@tcp:101:bash.0 Request processed in 7663us (7968us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1783966957.159692:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 206 00000100:00100000:3.0:1783966957.164552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.165811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563752832 00000100:00100000:0.0:1783966957.165827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563752832 00000100:00100000:0.0:1783966957.165905:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:0.0:1783966957.165916:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:11915:x1870624563752832:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966957.165951:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966957.165975:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067bac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6eee expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166011:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067bb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166026:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166037:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166170:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067bac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eee expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166190:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eee expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.166200:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.166203:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783966957.166206:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783966957.166287:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11915:x1870624563752832:12345-192.168.204.59@tcp:101:bash.0 Request processed in 372us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.166301:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 207 00000100:00100000:3.0:1783966957.170433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.171329:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753088 00000100:00100000:0.0:1783966957.171349:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753088 00000100:00100000:0.0:1783966957.171423:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 208 00000100:00100000:0.0:1783966957.171435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:11915:x1870624563753088:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:0.0:1783966957.171699:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.171717:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.171729:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966957.171794:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1783966957.171827:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc72af67 reply state 0000000010854c4f transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.171840:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.171847:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.171851:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966957.171854:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783966957.171895:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1783966957.172008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:11915:x1870624563753088:12345-192.168.204.59@tcp:36:bash.0 Request processed in 573us (1591us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1783966957.172018:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 208 00000020:00080000:0.0:1783966957.172024:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1783966957.181297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.181355:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753216 00000100:00100000:1.0:1783966957.181366:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753216 00000100:00100000:1.0:1783966957.181434:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:1.0:1783966957.181446:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+34:11915:x1870624563753216:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1783966957.181490:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966957.181515:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067bc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6ef5 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.181581:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ef5 expref: 35 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.181606:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ef5 expref: 35 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.181627:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:1.0:1783966957.181630:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966957.181634:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ee00, rc 0) 00000100:00100000:1.0:1783966957.181707:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:11915:x1870624563753216:12345-192.168.204.59@tcp:101:bash.0 Request processed in 262us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966957.181714:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 209 00000100:00100000:1.0:1783966957.185722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966957.185832:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753344 00000100:00100000:2.0:1783966957.185842:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753344 00000100:00100000:2.0:1783966957.185906:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783966957.185917:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:11915:x1870624563753344:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966957.185935:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966957.185958:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6efc expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783966957.185983:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a552cea, atime: 0x6a552ce8, ctime: 0x6a552cea, blocks: 0x8 00010000:00010000:2.0:1783966957.186006:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1783966957.186011:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966957.186019:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.186037:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.186060:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783966957.186118:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:11915:x1870624563753344:12345-192.168.204.59@tcp:101:bash.0 Request processed in 203us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966957.186125:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:1.0:1783966957.198600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966957.198830:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753472 00000100:00100000:2.0:1783966957.198840:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753472 00002000:00010000:2.0:1783966957.198888:0:8438:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1783966957.198893:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3d3ed80 with x1870624563753472 ext(0->18446744073709551615) 00002000:00010000:2.0:1783966957.198905:0:8438:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3d3ed80. 00000100:00100000:2.0:1783966957.198937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1783966957.198947:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563753472:12345-192.168.204.59@tcp:10:bash.0 00002000:00010000:2.0:1783966957.199240:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783966957.199244:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783966954 -> 1783966956 00002000:00010000:2.0:1783966957.199247:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783966952 -> 1783966952 00002000:00010000:2.0:1783966957.199249:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783966954 -> 1783966956 00002000:00010000:2.0:1783966957.199251:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1783966957.199307:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563753472:12345-192.168.204.59@tcp:10:bash.0 Request processed in 361us (717us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783966957.199316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00002000:00010000:2.0:1783966957.199319:0:8438:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1783966957.199322:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3d3ed80 with x1870624563753472 ext(0->18446744073709551615) 00002000:00010000:2.0:1783966957.199327:0:8438:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3d3ed80. 00000100:00100000:2.0:1783966957.290386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.290462:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753600 00000100:00100000:1.0:1783966957.290482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753600 00000100:00100000:1.0:1783966957.290565:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:1.0:1783966957.290576:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:12397:x1870624563753600:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:1.0:1783966957.290681:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290700:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290712:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290728:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290735:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290741:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290980:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290991:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.290999:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783966957.291052:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291063:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291082:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291089:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291095:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966957.291099:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291106:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291120:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966957.291123:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966957.291127:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291134:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067bcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291145:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291150:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291156:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291161:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966957.291171:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291177:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291186:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966957.291188:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966957.291191:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291197:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067bd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291211:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291216:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291222:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291227:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966957.291230:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291236:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291244:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:1.0:1783966957.291246:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966957.291255:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.291260:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067bdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.291341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:12397:x1870624563753600:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 766us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966957.291350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 210 00000100:00100000:1.0:1783966957.348119:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.348336:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753856 00000100:00100000:0.0:1783966957.348348:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753856 00000100:00100000:0.0:1783966957.348493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:0.0:1783966957.348505:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+35:12400:x1870624563753856:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966957.348529:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966957.348555:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067be4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348644:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348660:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348672:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348687:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348694:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.348702:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067bf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349333:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349360:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966957.349372:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783966957.349592:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349601:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349608:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349615:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.349619:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349625:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349638:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966957.349641:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.349645:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349651:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067beb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349663:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349668:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349680:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349685:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.349688:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349693:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349699:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966957.349701:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.349703:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349707:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349747:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067be4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f03 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349760:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f03 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.349767:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.349872:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783966957.349875:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0c00, rc 0) 00000100:00100000:0.0:1783966957.350093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12400:x1870624563753856:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1589us (1984us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1783966957.350112:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 211 00000100:00100000:1.0:1783966957.355862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.356257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563753984 00000100:00100000:0.0:1783966957.356272:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563753984 00000100:00100000:1.0:1783966957.356525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:1.0:1783966957.356538:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12400:x1870624563753984:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783966957.356649:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.356671:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 37 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.356682:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.356724:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 37 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.356737:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 37 pid: 10203 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.356754:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587925632:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966957.357289:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783966957.378876:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.379214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563754240 00000100:00100000:0.0:1783966957.379225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563754240 00000100:00100000:0.0:1783966957.379295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783966957.379306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:6639:x1870624563754240:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783966957.379667:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:6639:x1870624563754240:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 353us (791us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783966957.379677:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783966957.380220:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1870624587925632:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783966957.380255:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966957.385931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.386122:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563754368 00000100:00100000:1.0:1783966957.386134:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563754368 00010000:00010000:1.0:1783966957.386182:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 39 pid: 10203 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.386232:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:1.0:1783966957.386244:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:2400:x1870624563754368:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966957.386260:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966957.386267:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 39 pid: 10203 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386295:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 39 pid: 10203 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386862:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067b9e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ee7 expref: 39 pid: 10203 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386895:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:1.0:1783966957.386901:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386913:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386941:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.386984:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966957.387167:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed2a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:2400:x1870624563754368:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 924us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966957.387175:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00010000:00010000:3.0:1783966957.387317:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387335:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387399:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387408:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387415:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387429:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966957.387435:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387446:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387492:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:3.0:1783966957.387497:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966957.387502:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.387509:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966957.387642:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12400:x1870624563753984:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 31100us (31785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966957.387656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 212 00000100:00100000:1.0:1783966957.398055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.398189:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563754624 00000100:00100000:0.0:1783966957.398202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563754624 00000100:00100000:0.0:1783966957.398275:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:0.0:1783966957.398287:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+37:12400:x1870624563754624:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783966957.398554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:12400:x1870624563754624:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 268us (512us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1783966957.398562:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:0.0:1783966957.575896:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.576030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563754880 00000100:00100000:1.0:1783966957.576044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563754880 00000100:00100000:1.0:1783966957.576255:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 213 00000100:00100000:1.0:1783966957.576273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+38:12411:x1870624563754880:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:1.0:1783966957.576327:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966957.576357:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067c0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f0a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576478:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576499:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576514:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576536:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576544:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576571:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576733:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576743:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576750:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966957.576762:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1783966957.576904:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576912:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576919:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576926:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966957.576931:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576940:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576955:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966957.576959:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966957.576973:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576979:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.576996:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577002:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577007:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577012:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966957.577015:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577020:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577027:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966957.577029:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966957.577032:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577037:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067c1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577087:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067c0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f0a expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577117:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f0a expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.577213:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:1.0:1783966957.577216:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966957.577219:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e000, rc 0) 00000100:00100000:1.0:1783966957.577324:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+40:12411:x1870624563754880:12345-192.168.204.59@tcp:101:cat.0 Request processed in 1054us (1442us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1783966957.581202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.581317:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563755136 00000100:00100000:0.0:1783966957.581339:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563755136 00000100:00100000:0.0:1783966957.581448:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:0.0:1783966957.581474:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:12411:x1870624563755136:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:0.0:1783966957.581938:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:12411:x1870624563755136:12345-192.168.204.59@tcp:35:cat.0 Request processed in 478us (744us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783966957.581947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783966957.582723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 213 00010000:00010000:3.0:1783966957.623818:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966957.634091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.634213:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563755392 00000100:00100000:0.0:1783966957.634232:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563755392 00000100:00100000:0.0:1783966957.634329:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:0.0:1783966957.634356:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+41:12412:x1870624563755392:12345-192.168.204.59@tcp:36:rm.0 00010000:00010000:0.0:1783966957.634449:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1783966957.634496:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067bc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ef5 expref: 41 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634524:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f0a expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634536:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067bf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f03 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634549:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067bb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6eee expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634560:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.634566:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966957.634597:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634614:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634625:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.634974:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.635001:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.635009:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.635128:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.635137:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.635145:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783966957.635822:0:7847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1783966957.635837:0:7847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 433837066157ns, next at 434837063281ns, rc = 0 00010000:00010000:0.0:1783966957.637035:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637059:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637073:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637082:0:7847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637089:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637112:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637143:0:7847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783966957.637170:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637176:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637183:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637189:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.637193:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637201:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637213:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966957.637216:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783966957.637220:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637226:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c3f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.637246:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638005:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966957.638015:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638024:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783966957.638036:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638044:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638055:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:2.0:1783966957.638058:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783966957.638061:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638068:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067c46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.638094:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966957.638096:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966957.638098:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966957.639352:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639373:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639379:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966957.639384:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639392:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639407:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966957.639410:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966957.639414:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639421:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067c31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783966957.639439:0:7847:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bab30510 reply state 000000004b166cea transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639452:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.639468:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966957.639471:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783966957.639473:0:7847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783966957.640607:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:12412:x1870624563755392:12345-192.168.204.59@tcp:36:rm.0 Request processed in 6259us (6517us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783966957.640620:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 214 00000100:00100000:2.0:1783966957.750333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966957.750441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563755648 00000100:00100000:3.0:1783966957.750470:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563755648 00000100:00100000:3.0:1783966957.750690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:3.0:1783966957.750705:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+39:12418:x1870624563755648:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:3.0:1783966957.750756:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966957.750916:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067c4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f11 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751066:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751085:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751100:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751113:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751121:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966957.751127:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783966957.752302:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1783966957.754823:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.754925:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.754941:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.754995:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755003:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755036:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755043:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966957.755048:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755056:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755072:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966957.755076:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966957.755082:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755089:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067c54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966957.755111:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5deccf9 reply state 0000000060614064 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755125:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755132:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966957.755134:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966957.755138:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783966957.755191:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067c4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755208:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966957.755223:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:2.0:1783966957.755226:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783966957.755229:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631000, rc 0) 00000100:00100000:2.0:1783966957.757141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:12418:x1870624563755648:12345-192.168.204.59@tcp:101:bash.0 Request processed in 6422us (6799us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783966957.757158:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 215 00000100:00100000:3.0:1783966957.765276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.765599:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563755776 00000100:00100000:0.0:1783966957.765612:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563755776 00000100:00100000:0.0:1783966957.765709:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1783966957.765723:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563755776:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783966957.765748:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966957.765816:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f18 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783966957.765928:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783966957.765959:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=433s v=(0 0) 00010000:00010000:0.0:1783966957.765965:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966957.765980:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.766007:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.766025:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:0.0:1783966957.766108:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2402:x1870624563755776:12345-192.168.204.59@tcp:101:bash.0 Request processed in 389us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.766116:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00080000:2.0:1783966957.766332:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966957.771284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.771612:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563755904 00000100:00100000:1.0:1783966957.771628:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563755904 00000100:00100000:1.0:1783966957.771725:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1783966957.771741:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:12418:x1870624563755904:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1783966957.771840:0:8714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966957.771874:0:8714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f1f expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.771925:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.771938:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966957.771944:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966957.771951:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 9 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.772037:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.772055:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 9 pid: 8433 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.772077:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587925760:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966957.772252:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1783966957.777523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.778092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563756032 00000100:00100000:1.0:1783966957.778106:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563756032 00010000:00010000:1.0:1783966957.778181:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 10 pid: 8433 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.778242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 96 00000100:00100000:1.0:1783966957.778255:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2400:x1870624563756032:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966957.778278:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966957.778309:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 10 pid: 8433 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.778325:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 10 pid: 8433 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.778526:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966957.778533:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966957.778565:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 10 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.778578:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 10 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.778634:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 10 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966957.778655:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1870624587925888:192.168.204.59@tcp:105: 00000100:00100000:1.0:1783966957.778812:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966957.781537:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1870624587925888:192.168.204.59@tcp:105: 00010000:00010000:2.0:1783966957.781584:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966957.781675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2400:x1870624563756032:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3420us (4167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966957.781689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 96 00010000:00010000:0.0:1783966957.783198:0:8714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316067c70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f18 expref: 9 pid: 8433 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966957.783233:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8714:1870624587925760:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966957.783304:0:8714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 8 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.783323:0:8714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e200, rc 0) 00000100:00100000:0.0:1783966957.783415:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:12418:x1870624563755904:12345-192.168.204.59@tcp:101:bash.0 Request processed in 11678us (12151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966957.783425:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1783966957.787984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966957.789067:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563756288 00000100:00100000:3.0:1783966957.789082:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563756288 00000100:00100000:3.0:1783966957.789274:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1783966957.789288:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+42:12418:x1870624563756288:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1783966957.789990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12418:x1870624563756288:12345-192.168.204.59@tcp:35:bash.0 Request processed in 700us (2468us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783966957.790002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1783966957.986310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966957.986612:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563756416 00000100:00100000:1.0:1783966957.986629:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563756416 00000100:00100000:1.0:1783966957.986744:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:1.0:1783966957.986760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+43:12434:x1870624563756416:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966957.987037:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966957.987070:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f26 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987191:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987213:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987231:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966957.987327:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783966957.987333:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966957.987360:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987394:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f26 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987419:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f26 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966957.987429:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966957.987433:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966957.987439:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ec00, rc 0) 00000100:00100000:1.0:1783966957.987559:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:12434:x1870624563756416:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 801us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966957.987568:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 216 00000100:00100000:2.0:1783966957.994936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966957.995125:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563756672 00000100:00100000:0.0:1783966957.995140:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563756672 00000100:00100000:0.0:1783966957.995228:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:0.0:1783966957.995242:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+44:12434:x1870624563756672:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966957.995272:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966957.995304:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f2d expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.995938:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067c93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.995961:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.995977:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966957.995992:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783966957.996176:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067c8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f2d expref: 47 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.996201:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067c93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f2d expref: 46 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966957.996224:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:0.0:1783966957.996228:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966957.996232:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783966957.996333:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+46:12434:x1870624563756672:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1093us (1415us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1783966957.997299:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 217 00000100:00100000:2.0:1783966958.001521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.001723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.001840:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757056 00000100:00100000:3.0:1783966958.001854:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757056 00000100:00100000:3.0:1783966958.001956:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783966958.001969:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+46:2401:x1870624563757056:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966958.001991:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966958.002032:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067c93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f2d expref: 46 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.002054:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:3.0:1783966958.002061:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966958.002145:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:2401:x1870624563757056:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 179us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.002154:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00080000:2.0:1783966958.002226:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966958.002404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563756928 00000100:00100000:1.0:1783966958.002420:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563756928 00000100:00100000:1.0:1783966958.002475:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:1.0:1783966958.002490:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+45:12434:x1870624563756928:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966958.002519:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.002544:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067ca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f34 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.002994:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.003041:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.003056:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966958.003073:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783966958.004022:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f34 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.004048:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f34 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.004058:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:1.0:1783966958.004061:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783966958.004065:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966958.004157:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:12434:x1870624563756928:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1672us (2653us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1783966958.004167:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 218 00000100:00100000:2.0:1783966958.014907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.015252:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757184 00000100:00100000:1.0:1783966958.015269:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757184 00000100:00100000:1.0:1783966958.015515:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:1.0:1783966958.015532:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563757184:12345-192.168.204.59@tcp:1:lfs.0 00010000:00010000:1.0:1783966958.015701:0:14225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.015734:0:14225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 8 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.015864:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783966958.015871:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783966958.015877:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.016021:0:14225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 8 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.016040:0:14225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 8 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.016266:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14225:1870624587926016:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966958.016543:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd180 going to sleep for 11 seconds 00000100:00100000:3.0:1783966958.021015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.021300:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757312 00000100:00100000:2.0:1783966958.021316:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757312 00002000:00100000:2.0:1783966958.021398:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a04c3ea3100 x1870624563757312/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:119/0 lens 504/0 e 0 to 0 dl 1783966969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783966958.021414:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3ea3100 with x1870624563757312 ext(0->8) 00010000:00010000:2.0:1783966958.021433:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 9 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.021492:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 9 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783966958.021502:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3ea3100 00000100:00100000:0.0:1783966958.021536:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14225:1870624587926016:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966958.021595:0:14225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.021982:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:2.0:1783966958.021998:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563757312:12345-192.168.204.59@tcp:4:lfs.0 00000100:00100000:1.0:1783966958.024418:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1783966958.024446:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1783966958.026766:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2401:x1870624563757312:12345-192.168.204.59@tcp:4:lfs.0 Request processed in 4754us (5749us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783966958.026812:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00002000:00100000:2.0:1783966958.026830:0:8437:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a04c3ea3100 x1870624563757312/t4294967309(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:119/0 lens 504/448 e 0 to 0 dl 1783966969 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783966958.026843:0:8437:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3ea3100 with x1870624563757312 ext(0->8) 00010000:00010000:2.0:1783966958.026860:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.026883:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783966958.026893:0:8437:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a04c3ea3100 00000100:00100000:2.0:1783966958.030888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.031220:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757440 00000100:00100000:3.0:1783966958.031256:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757440 00010000:00010000:3.0:1783966958.031317:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.031427:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 97 00000100:00100000:2.0:1783966958.031444:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2402:x1870624563757440:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966958.031486:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783966958.031527:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783966958.031530:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783966957 00002000:00010000:2.0:1783966958.031532:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783966957 00002000:00010000:2.0:1783966958.031535:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783966957 00002000:00010000:2.0:1783966958.031537:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783966958.031547:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.031566:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.031613:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dbe3643/0x9269c8b316067c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f1f expref: 11 pid: 8714 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.031651:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966958.031657:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966958.031666:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.031679:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.031731:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966958.031796:0:14225:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031812:0:14225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031868:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.031869:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2402:x1870624563757440:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 429us (997us total) trans 0 rc 0/0 00010000:00010000:0.0:1783966958.031887:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.031888:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 97 00010000:00010000:0.0:1783966958.031900:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031909:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966958.031915:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031927:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031942:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.031950:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030d478e1/0x9269c8b316067cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.032015:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563757184:12345-192.168.204.59@tcp:1:lfs.0 Request processed in 16487us (17125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966958.032028:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1783966958.042703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.044176:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757696 00000100:00100000:0.0:1783966958.044199:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757696 00000100:00100000:0.0:1783966958.044301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1783966958.044315:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+47:12434:x1870624563757696:12345-192.168.204.59@tcp:35:lfs.0 00000004:00010000:0.0:1783966958.044439:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f34 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966958.044802:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1783966958.044856:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783966958.045276:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1783966958.045329:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.045350:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.045360:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.045412:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.045434:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 51 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.045465:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587926144:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966958.045601:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd480 going to sleep for 11 seconds 00000100:00100000:0.0:1783966958.051650:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1870624587926144:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966958.051718:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.051949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.052700:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757824 00000100:00100000:2.0:1783966958.052726:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757824 00010000:00010000:2.0:1783966958.052842:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 52 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.052895:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:2.0:1783966958.052908:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+52:2400:x1870624563757824:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966958.052928:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966958.052935:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 52 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.052951:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 52 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.052980:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067c62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f11 expref: 52 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.053003:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:2.0:1783966958.053008:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.053021:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.053029:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.053263:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966958.053549:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.053560:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966958.053711:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1783966958.053889:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1783966958.054002:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587926272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783966958.054086:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966958.054136:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966958.054291:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+53:2400:x1870624563757824:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 1382us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.054319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 98 00000100:00100000:1.0:1783966958.054425:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587926272 00000100:00100000:1.0:1783966958.054432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587926272 00000100:00100000:1.0:1783966958.054507:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783966958.054518:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587926272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783966958.054638:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587926272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.054646:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:2.0:1783966958.054944:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966958.056641:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587926272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783966958.056919:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1783966958.057033:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587926400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783966958.057270:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966958.057305:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966958.058523:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587926400 00000100:00100000:1.0:1783966958.058536:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587926400 00000100:00100000:1.0:1783966958.058620:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1783966958.058638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1870624587926400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783966958.058930:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1870624587926400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 294us (1659us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783966958.058939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783966958.059292:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1870624587926400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783966958.059394:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1783966958.059464:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059477:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059485:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059491:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966958.059497:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059506:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059528:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:2.0:1783966958.059531:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783966958.059535:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.059542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316067cbd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783966958.059687:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783966958.059766:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1783966958.059828:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434261056392ns, next at 435261053301ns, rc = 0 00000001:00080000:2.0:1783966958.059836:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1783966958.059865:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a04c1ccad00) 00010000:00010000:2.0:1783966958.059868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783966958.059877:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ca8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f34 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.059989:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:12434:x1870624563757696:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 15677us (18621us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783966958.059998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000020:00080000:2.0:1783966958.060002:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783966958.066884:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.066975:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563757952 00000100:00100000:1.0:1783966958.066988:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563757952 00000100:00100000:1.0:1783966958.067222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:1.0:1783966958.067237:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+54:12434:x1870624563757952:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966958.067292:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.067323:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067cc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f3b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.067547:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f3b expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.067566:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f3b expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.067589:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966958.067594:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966958.067598:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ea00, rc 0) 00000100:00100000:1.0:1783966958.067699:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:12434:x1870624563757952:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 466us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.067707:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 219 00000100:00100000:2.0:1783966958.070496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.070823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563758208 00000100:00100000:3.0:1783966958.070837:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563758208 00000100:00100000:3.0:1783966958.070909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1783966958.070922:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+55:12434:x1870624563758208:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783966958.071282:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:12434:x1870624563758208:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 361us (799us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1783966958.071292:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:2.0:1783966958.159041:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.159486:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563758336 00000100:00100000:0.0:1783966958.159501:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563758336 00000100:00100000:0.0:1783966958.159584:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:0.0:1783966958.159598:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:12444:x1870624563758336:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:0.0:1783966958.159732:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.159758:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.160430:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161202:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161223:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161233:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161877:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161891:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.161899:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966958.162066:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162086:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162093:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162100:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162107:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966958.162111:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162119:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162208:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966958.162212:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966958.162218:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162225:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316067ccb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162244:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162250:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162265:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162271:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966958.162274:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162282:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162291:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:2.0:1783966958.162294:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966958.162298:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162303:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067cd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162326:0:7847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162333:0:7847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162339:0:7847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162345:0:7847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966958.162348:0:7847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162365:0:7847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162501:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966958.162504:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783966958.162507:0:7847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.162513:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067cd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.162879:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:12444:x1870624563758336:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 3276us (3847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.162892:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 220 00000100:00100000:0.0:1783966958.203923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.204723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563758592 00000100:00100000:1.0:1783966958.204737:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563758592 00000100:00100000:1.0:1783966958.204857:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:1.0:1783966958.204870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf014050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+56:12447:x1870624563758592:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966958.204902:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.204932:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067ce0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f42 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.205036:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.205054:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.205085:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.205099:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.205108:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.207579:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208434:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208462:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208472:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966958.208488:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783966958.208605:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208613:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208620:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208627:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.208820:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208830:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208847:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966958.208851:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966958.208857:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208864:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067ce7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208882:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208888:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208894:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208900:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.208904:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208910:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208919:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:1.0:1783966958.208922:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966958.208934:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.208939:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067cee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.209005:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067ce0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.209022:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.209030:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966958.209032:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966958.209035:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e200, rc 0) 00000100:00100000:1.0:1783966958.209223:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf014050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12447:x1870624563758592:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 4354us (5314us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783966958.209233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 221 00000100:00100000:0.0:1783966958.214311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.214872:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563758720 00000100:00100000:1.0:1783966958.214885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563758720 00000100:00100000:1.0:1783966958.214966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:1.0:1783966958.214979:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12447:x1870624563758720:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783966958.215087:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215109:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215135:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215210:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215218:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215227:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215234:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.215239:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215249:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215266:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966958.215270:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783966958.215275:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.215284:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274fa00/0x9269c8b316067d03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966958.215382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12447:x1870624563758720:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 405us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.215391:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 222 00000100:00100000:2.0:1783966958.219115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.219367:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563758976 00000100:00100000:3.0:1783966958.219382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563758976 00000100:00100000:3.0:1783966958.219465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1783966958.219477:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+58:12447:x1870624563758976:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783966958.220328:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:12447:x1870624563758976:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 836us (1209us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1783966958.220346:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:0.0:1783966958.294601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.294925:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563759232 00000100:00100000:2.0:1783966958.294940:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563759232 00000100:00100000:2.0:1783966958.295023:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:2.0:1783966958.295036:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:12457:x1870624563759232:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966958.295071:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966958.295076:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783966958.295129:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067c85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f26 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295157:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:2.0:1783966958.295163:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966958.295184:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067d0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f49 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295358:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295374:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295384:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295435:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.295458:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 59 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.295474:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926528:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966958.295608:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966958.301838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.301986:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926528:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966958.302027:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.302257:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563759360 00000100:00100000:3.0:1783966958.302267:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563759360 00010000:00010000:3.0:1783966958.302341:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 60 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.302385:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:3.0:1783966958.302397:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:2401:x1870624563759360:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966958.302444:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966958.302463:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 60 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302479:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 60 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302511:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e200/0x9269c8b316067cf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f42 expref: 60 pid: 6519 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302534:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.302539:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302553:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302562:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.302604:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966958.302704:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:2401:x1870624563759360:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 307us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.302713:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00010000:00010000:0.0:1783966958.303823:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.303838:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966958.303865:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783966958.304065:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067d0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 60 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.304089:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 59 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.304098:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966958.304101:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783966958.304104:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:0.0:1783966958.304264:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:12457:x1870624563759232:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9229us (9682us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1783966958.304274:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 223 00000100:00100000:0.0:1783966958.309194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.309353:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563759488 00000100:00100000:1.0:1783966958.309366:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563759488 00000100:00100000:1.0:1783966958.309463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:1.0:1783966958.309495:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+59:12457:x1870624563759488:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1783966958.309531:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.309561:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f50 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309610:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309631:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309657:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309861:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309881:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.309891:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966958.309894:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966958.309898:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f800, rc 0) 00000100:00100000:1.0:1783966958.309972:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:12457:x1870624563759488:12345-192.168.204.59@tcp:101:bash.0 Request processed in 479us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.309980:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 224 00000100:00100000:2.0:1783966958.314088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.314258:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563759744 00000100:00100000:3.0:1783966958.314271:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563759744 00000100:00100000:3.0:1783966958.314891:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 225 00000100:00100000:3.0:1783966958.314906:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+60:12457:x1870624563759744:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:3.0:1783966958.315273:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.315297:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.315323:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783966958.315383:0:10203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1783966958.315416:0:10203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f79264b7 reply state 000000007a9aadee transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.315431:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.315440:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.315443:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783966958.315456:0:10203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783966958.315579:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:12457:x1870624563759744:12345-192.168.204.59@tcp:36:bash.0 Request processed in 675us (1507us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1783966958.315586:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 225 00000020:00080000:3.0:1783966958.315593:0:10203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783966958.320207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.320315:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563759872 00000100:00100000:2.0:1783966958.320328:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563759872 00000100:00100000:2.0:1783966958.320600:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:2.0:1783966958.320613:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:12457:x1870624563759872:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783966958.320760:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966958.320862:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067d34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f57 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.320995:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.321014:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 64 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.321024:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.321073:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 64 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.321088:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 64 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.321104:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926656:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966958.321873:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9240 going to sleep for 11 seconds 00000100:00100000:0.0:1783966958.326040:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926656:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966958.326085:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.328160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.329215:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760000 00000100:00100000:3.0:1783966958.329230:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760000 00010000:00010000:2.0:1783966958.329755:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 65 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.329843:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:2.0:1783966958.329857:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:2401:x1870624563760000:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966958.329879:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966958.329907:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 65 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.329923:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 65 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.329954:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067d11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f49 expref: 65 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.329977:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966958.329983:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.329996:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.330006:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.330119:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966958.330213:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+64:2401:x1870624563760000:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 358us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.330222:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00010000:00010000:0.0:1783966958.332873:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.332896:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966958.333240:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783966958.333246:0:7847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783966958.333285:0:7847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.333556:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067d34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 64 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.333585:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 63 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.333596:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966958.333600:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966958.333604:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:0.0:1783966958.333971:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:12457:x1870624563759872:12345-192.168.204.59@tcp:101:bash.0 Request processed in 13356us (13775us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966958.333982:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 226 00000100:00100000:0.0:1783966958.339002:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.339102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760256 00000100:00100000:2.0:1783966958.339189:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760256 00000100:00100000:2.0:1783966958.339325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1783966958.339346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+63:12457:x1870624563760256:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1783966958.339725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+64:12457:x1870624563760256:12345-192.168.204.59@tcp:35:bash.0 Request processed in 381us (738us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1783966958.339761:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1783966958.409152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.409288:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760384 00000100:00100000:1.0:1783966958.409304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760384 00000100:00100000:1.0:1783966958.409394:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:1.0:1783966958.409443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+64:12463:x1870624563760384:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783966958.409491:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.409520:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f5e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409610:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409630:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409646:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966958.409705:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783966958.409710:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966958.409735:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409766:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f5e expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409848:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f5e expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.409858:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966958.409861:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966958.409865:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ee00, rc 0) 00000100:00100000:1.0:1783966958.409945:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563760384:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 510us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.409963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 227 00000100:00100000:1.0:1783966958.418524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.418913:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760512 00000100:00100000:3.0:1783966958.418926:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760512 00000100:00100000:3.0:1783966958.419054:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:3.0:1783966958.419065:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563760512:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966958.419094:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966958.419149:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067d50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f65 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419240:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419259:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419273:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419286:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419293:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419312:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419431:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419441:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419457:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966958.419514:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783966958.419519:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966958.419544:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419565:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419575:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419583:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419590:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419597:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966958.419602:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419611:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419625:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966958.419630:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966958.419636:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419884:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316067d57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419903:0:10203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419910:0:10203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419922:0:10203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419928:0:10203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966958.419931:0:10203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419937:0:10203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419946:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:3.0:1783966958.419949:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966958.419952:0:10203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419959:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b316067d5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.419994:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316067d50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.420008:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 66 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.420016:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.420018:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966958.420021:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00100000:3.0:1783966958.420271:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12463:x1870624563760512:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1206us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.420289:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 228 00000100:00100000:2.0:1783966958.425138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966958.425203:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.425607:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760896 00000100:00100000:0.0:1783966958.425622:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760896 00000100:00100000:0.0:1783966958.425721:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:0.0:1783966958.425754:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12463:x1870624563760896:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966958.425823:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966958.425855:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067d6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f6c expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426007:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426026:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426034:0:7847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426043:0:7847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426089:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.426116:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.426139:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926784:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966958.428862:0:7847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.428890:0:7847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966958.428928:0:7847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926912:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966958.429021:0:7847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd180 going to sleep for 11 seconds 00000100:00100000:2.0:1783966958.435265:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563760640 00000100:00100000:2.0:1783966958.435286:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563760640 00010000:00010000:2.0:1783966958.435528:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 68 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.435639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:2.0:1783966958.435657:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c2bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:2401:x1870624563760640:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966958.435678:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966958.435687:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 68 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.435704:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 68 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.435735:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966958.435742:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.435753:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.435760:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966958.436220:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c2bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:2401:x1870624563760640:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 562us (11096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.436250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 101 00000100:00100000:0.0:1783966958.436874:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:2.0:1783966958.437233:0:7847:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.59@tcp) returned -22 from blocking AST (req@000000004a40be2a x1870624587926784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.437257:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f65 expref: 67 pid: 10203 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966958.437279:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926784:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966958.437294:0:7847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7847:1870624587926912:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966958.437359:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966958.437365:0:7847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.437377:0:7847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.437387:0:7847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.437884:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761024 00000100:00100000:3.0:1783966958.437894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761024 00010000:00010000:3.0:1783966958.437944:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.437997:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1783966958.438008:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:2400:x1870624563761024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966958.438027:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966958.438034:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438046:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438068:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067d3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f57 expref: 67 pid: 7847 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438081:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.438085:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438094:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438102:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.438161:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966958.438227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:2400:x1870624563761024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 220us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.438236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00010000:00010000:0.0:1783966958.440175:0:7847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.440194:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966958.440223:0:7847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783966958.440904:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067d6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 67 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.440933:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 66 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.440944:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966958.440947:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783966958.440950:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0c00, rc 0) 00000100:00100000:0.0:1783966958.441050:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12463:x1870624563760896:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 15297us (15844us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1783966958.441061:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 229 00000100:00100000:0.0:1783966958.450433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.450912:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761280 00000100:00100000:3.0:1783966958.450926:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761280 00000100:00100000:3.0:1783966958.451016:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1783966958.451030:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12463:x1870624563761280:12345-192.168.204.59@tcp:103:lfs.0 00010000:00010000:3.0:1783966958.451053:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966958.451085:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067cc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f3b expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.451124:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.451131:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966958.451208:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563761280:12345-192.168.204.59@tcp:103:lfs.0 Request processed in 182us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.451217:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1783966958.456221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.456365:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761408 00000100:00100000:0.0:1783966958.456381:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761408 00000100:00100000:0.0:1783966958.456466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:0.0:1783966958.456479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563761408:12345-192.168.204.59@tcp:58:lfs.0 00010000:00010000:0.0:1783966958.456653:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.456683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.456697:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783966958.456843:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1783966958.456955:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563761408:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 478us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966958.456964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 230 00000100:00100000:2.0:1783966958.465404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.465555:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761536 00000100:00100000:3.0:1783966958.465565:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761536 00000100:00100000:3.0:1783966958.465633:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 231 00000100:00100000:3.0:1783966958.465645:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+65:12463:x1870624563761536:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783966958.465670:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966958.465695:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f73 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465758:0:10203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465819:0:10203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 66 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465838:0:10203:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465852:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 66 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465867:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.465870:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783966958.465873:0:10203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 66 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.465880:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:3.0:1783966958.466076:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12463:x1870624563761536:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 299us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.466088:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 231 00010000:00010000:3.0:1783966958.648785:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966958.903010:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966958.903021:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966958.903051:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1783966958.903062:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966958.903319:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587927040:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783966958.903479:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966958.911982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.912108:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761664 00000100:00100000:0.0:1783966958.912120:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761664 00000100:00100000:3.0:1783966958.912389:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587927040:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783966958.912490:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:0.0:1783966958.912502:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12464:x1870624563761664:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783966958.912544:0:7847:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783966958.912689:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12464:x1870624563761664:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 189us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966958.912697:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 232 00000100:00100000:3.0:1783966958.917309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.917556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563761792 00000100:00100000:1.0:1783966958.917570:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563761792 00000100:00100000:1.0:1783966958.917698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:1.0:1783966958.917712:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12464:x1870624563761792:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783966958.917865:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917888:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917906:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917926:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917934:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917941:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917974:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.917985:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918017:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966958.918087:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783966958.918093:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783966958.918113:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918128:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918134:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918143:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918151:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.918157:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918167:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918183:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:1.0:1783966958.918186:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966958.918192:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918198:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067d8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918230:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918236:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918242:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918247:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.918250:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918256:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918264:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9a05f5465b00) 00010000:00010000:1.0:1783966958.918267:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966958.918270:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918275:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067d96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918290:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918297:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918302:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918314:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966958.918317:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918324:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918334:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966958.918336:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966958.918339:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.918344:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067d9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966958.918649:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12464:x1870624563761792:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 936us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.918659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 233 00000100:00100000:2.0:1783966958.923169:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.923270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563762048 00000100:00100000:3.0:1783966958.923285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563762048 00000100:00100000:3.0:1783966958.923369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:3.0:1783966958.923381:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+66:12464:x1870624563762048:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966958.923413:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966958.923480:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067da4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f7a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.923637:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.923659:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.923674:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966958.923689:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783966958.924454:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924466:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924474:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924482:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966958.924487:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924496:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924513:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966958.924516:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783966958.924521:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924544:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924607:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067da4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f7a expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924619:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:3.0:1783966958.924621:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783966958.924625:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067da4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f7a expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.924636:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0600, rc 0) 00000100:00100000:3.0:1783966958.924736:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762048:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1356us (1581us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1783966958.924745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 234 00000100:00100000:2.0:1783966958.930679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.930855:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563762176 00000100:00100000:3.0:1783966958.930868:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563762176 00000100:00100000:3.0:1783966958.930948:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 235 00000100:00100000:3.0:1783966958.930961:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762176:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783966958.931029:0:10203:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783966958.931189:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762176:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 229us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966958.931198:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 235 00000100:00100000:2.0:1783966958.936402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.936548:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563762432 00000100:00100000:0.0:1783966958.936564:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563762432 00000100:00100000:0.0:1783966958.936669:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:0.0:1783966958.936683:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762432:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966958.936718:0:7847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966958.936722:0:7847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783966958.936763:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ee00/0x9269c8b316067d49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f5e expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.936872:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:0.0:1783966958.936878:0:7847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966958.936899:0:7847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067db9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f81 expref: -99 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783966958.937482:0:7847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1783966958.937675:0:7847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067dc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.937693:0:7847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.937705:0:7847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.937870:0:7847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1000/0x9269c8b316067db9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f81 expref: 69 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.937889:0:7847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f81 expref: 68 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966958.937898:0:7847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:0.0:1783966958.937900:0:7847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783966958.937904:0:7847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0600, rc 0) 00000100:00100000:0.0:1783966958.938029:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:12464:x1870624563762432:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1349us (1647us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783966958.938039:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 236 00000100:00100000:2.0:1783966958.943211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.943366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563762688 00000100:00100000:3.0:1783966958.943383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563762688 00000100:00100000:3.0:1783966958.943476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:3.0:1783966958.943515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:12464:x1870624563762688:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783966958.943608:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966958.943656:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0600/0x9269c8b316067dc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f81 expref: 68 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943680:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05ed1b4c00) 00010000:00010000:3.0:1783966958.943692:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966958.943723:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943740:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943751:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943804:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943812:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.943820:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944560:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944570:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944594:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944600:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966958.944606:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944614:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944627:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966958.944630:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966958.944679:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944687:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0600/0x9269c8b316067dce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944704:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944710:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944717:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944722:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966958.944725:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944740:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944749:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7e4091d (ffff9a04c3424800) 00010000:00010000:3.0:1783966958.944751:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966958.944754:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.944760:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067dd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7e4091d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.945584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762688:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 2063us (2379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783966958.945597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 237 00000100:00100000:2.0:1783966958.950033:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.950137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563762816 00000100:00100000:1.0:1783966958.950151:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563762816 00000100:00100000:1.0:1783966958.950230:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:1.0:1783966958.950242:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+67:12464:x1870624563762816:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966958.950272:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966958.950320:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067ddc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f88 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950377:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950421:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950453:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950606:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f600/0x9269c8b316067ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950630:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.950641:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:1.0:1783966958.950645:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966958.950649:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e400, rc 0) 00000100:00100000:1.0:1783966958.950725:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:12464:x1870624563762816:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 485us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.950734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 238 00000100:00100000:2.0:1783966958.960016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966958.960129:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763072 00000100:00100000:1.0:1783966958.960143:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763072 00000100:00100000:1.0:1783966958.960222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:1.0:1783966958.960234:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+68:12464:x1870624563763072:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783966958.960357:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.960380:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.960417:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783966958.960661:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1783966958.960673:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435161901862ns, next at 436161898494ns, rc = 0 00000004:00010000:1.0:1783966958.960742:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000643a0921 reply state 000000006afd1854 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.960759:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966958.960822:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:1.0:1783966958.960827:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783966958.960831:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783966958.960975:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+70:12464:x1870624563763072:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 741us (977us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783966958.960984:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 239 00000100:00100000:2.0:1783966958.964268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.964451:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763200 00000100:00100000:3.0:1783966958.964464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763200 00000100:00100000:3.0:1783966958.964543:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 240 00000100:00100000:3.0:1783966958.964555:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+70:12464:x1870624563763200:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783966958.964606:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783966958.964635:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f8f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.964717:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966958.964735:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966958.967580:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587927168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966958.967695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783966958.968598:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:2.0:1783966958.968609:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783966958.968615:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00100000:2.0:1783966958.968709:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+71:12464:x1870624563763200:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 4151us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.968721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 240 00000100:00100000:1.0:1783966958.968810:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587927168 00000100:00100000:1.0:1783966958.968821:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587927168 00000100:00100000:1.0:1783966958.968874:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783966958.968886:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587927168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966958.968943:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966958.969023:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587927168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966958.969030:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783966958.969415:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587927168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966958.973589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.973893:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763328 00000100:00100000:0.0:1783966958.973908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763328 00000100:00100000:0.0:1783966958.974080:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:0.0:1783966958.974093:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2401:x1870624563763328:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783966958.974548:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2401:x1870624563763328:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 456us (969us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1783966958.974558:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00080000:0.0:1783966958.974591:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966958.977953:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.978234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763584 00000100:00100000:3.0:1783966958.978252:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763584 00000100:00100000:3.0:1783966958.978540:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1783966958.978556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+71:12464:x1870624563763584:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783966958.978962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+72:12464:x1870624563763584:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 409us (1020us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1783966958.978971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1783966958.989272:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966958.989371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763840 00000100:00100000:0.0:1783966958.989387:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763840 00000100:00100000:0.0:1783966958.989471:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:0.0:1783966958.989482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+72:12464:x1870624563763840:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783966958.989618:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+72:12464:x1870624563763840:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966958.989629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 241 00000100:00100000:0.0:1783966958.993622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966958.993738:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563763968 00000100:00100000:3.0:1783966958.993748:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563763968 00000100:00100000:2.0:1783966958.993986:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 242 00000100:00100000:2.0:1783966958.994000:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+72:12464:x1870624563763968:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783966958.994021:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966958.994044:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067df8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f96 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994118:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994203:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994216:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966958.994282:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966958.994304:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994333:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067df8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f96 expref: 74 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994351:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f96 expref: 73 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966958.994359:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:2.0:1783966958.994362:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783966958.994365:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783966958.994506:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+73:12464:x1870624563763968:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 510us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966958.994513:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 242 00000100:00100000:3.0:1783966959.002545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.002683:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764096 00000100:00100000:0.0:1783966959.002699:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764096 00000100:00100000:0.0:1783966959.002817:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1783966959.002828:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+10:2400:x1870624563764096:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783966959.002847:0:8714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966959.002870:0:8714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6f9d expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783966959.002900:0:8714:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552cee, blocks: 0x0 00010000:00010000:0.0:1783966959.002941:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1783966959.002948:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783966959.002961:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 11 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.002981:0:8714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 11 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.003005:0:8714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783966959.003078:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2400:x1870624563764096:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 252us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.003086:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:1.0:1783966959.026758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966959.026994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764352 00000100:00100000:3.0:1783966959.027021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764352 00000100:00100000:3.0:1783966959.027119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:3.0:1783966959.027134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+73:12464:x1870624563764352:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783966959.038514:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+73:12464:x1870624563764352:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 632us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966959.038556:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 243 00000100:00100000:0.0:1783966959.039164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.039550:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764480 00000100:00100000:1.0:1783966959.039589:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764480 00000100:00100000:1.0:1783966959.039686:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:1.0:1783966959.039698:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:12464:x1870624563764480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966959.039722:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966959.039745:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fa4 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.039829:0:14225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 12 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.039839:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966959.039844:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966959.039849:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.039887:0:14225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 12 pid: 8714 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.039901:0:14225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 12 pid: 8714 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966959.039915:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14225:1870624587927296:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966959.040052:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c97f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783966959.049937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.050663:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764608 00000100:00100000:2.0:1783966959.050679:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764608 00010000:00010000:2.0:1783966959.050732:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 13 pid: 8714 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.050813:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:2.0:1783966959.050823:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2401:x1870624563764608:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966959.050840:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966959.050870:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 13 pid: 8714 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.050906:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 13 pid: 8714 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.050933:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966959.050938:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966959.050949:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 13 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.050961:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 13 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.051140:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076554d54/0x9269c8b316067e06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f9d expref: 13 pid: 8714 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.051169:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2682d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14225:1870624587927296:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966959.051226:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.051232:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 12 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.051275:0:6505:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1870624587927424:192.168.204.59@tcp:105: 00010000:00010000:0.0:1783966959.051276:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fa00, rc 0) 00000100:00100000:0.0:1783966959.052275:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+12:12464:x1870624563764480:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 12571us (13106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.052291:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:2.0:1783966959.052299:0:6505:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783966959.056607:0:6505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6505:1870624587927424:192.168.204.59@tcp:105: 00010000:00010000:2.0:1783966959.056961:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966959.057134:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2401:x1870624563764608:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 6309us (7207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966959.057148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:0.0:1783966959.060224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.060693:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764736 00000100:00100000:1.0:1783966959.060707:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764736 00002000:00100000:1.0:1783966959.060765:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9a04c3d3df80 x1870624563764736/t0(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:120/0 lens 504/0 e 0 to 0 dl 1783966970 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783966959.060821:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3d3df80 with x1870624563764736 ext(0->12) 00002000:00010000:1.0:1783966959.060828:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3d3df80 00000100:00100000:1.0:1783966959.060874:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1783966959.060884:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+11:2400:x1870624563764736:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783966959.061933:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2400:x1870624563764736:12345-192.168.204.59@tcp:4:lhsmtool_posix.0 Request processed in 1043us (1716us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1783966959.061944:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00002000:00100000:1.0:1783966959.061954:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9a04c3d3df80 x1870624563764736/t4294967321(0) o4->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:120/0 lens 504/448 e 0 to 0 dl 1783966970 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783966959.061962:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c3d3df80 with x1870624563764736 ext(0->12) 00002000:00010000:1.0:1783966959.061967:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c3d3df80 00000100:00100000:0.0:1783966959.075709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.078275:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764864 00000100:00100000:1.0:1783966959.078293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764864 00000100:00100000:1.0:1783966959.078395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 244 00000100:00100000:1.0:1783966959.078606:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+73:12464:x1870624563764864:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783966959.080726:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1783966959.080748:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1783966959.080808:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1783966959.080839:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05c9dcdcc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783966959.080844:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f4ddf700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c9dcd900 00000020:00080000:3.0:1783966959.080847:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f4ddfd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c35d2e00 00000004:00080000:3.0:1783966959.080883:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783966959.080906:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05d0da9f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783966959.080910:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05d0da9240 00000020:00080000:3.0:1783966959.080912:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c5527600 00010000:00010000:0.0:1783966959.081000:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081013:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081021:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081028:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081034:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081047:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081067:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a05ed1b4300) 00010000:00010000:0.0:1783966959.081070:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966959.081075:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081081:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630e00/0x9269c8b316067b12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081122:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081129:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081134:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081152:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081156:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081161:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081170:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a04c3424100) 00010000:00010000:0.0:1783966959.081172:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966959.081175:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081181:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067bba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081199:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081205:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081211:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081216:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081219:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081225:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081244:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966959.081247:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966959.081250:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081256:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067c38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081277:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081284:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081290:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081295:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081298:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081320:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081333:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a05ed1b4d00) 00010000:00010000:0.0:1783966959.081335:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966959.081341:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081347:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316067c5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081379:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081386:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081394:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081402:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081416:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081423:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081439:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966959.081444:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783966959.081447:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081456:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316067d2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081468:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081480:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081486:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081496:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966959.081499:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081511:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081520:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:0.0:1783966959.081522:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783966959.081526:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.081535:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067dea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.082111:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587927552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783966959.082229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966959.082553:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587927552 00000100:00100000:2.0:1783966959.082564:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587927552 00000100:00100000:2.0:1783966959.082624:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783966959.082645:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1870624587927552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783966959.082677:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1783966959.082723:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a552ced, atime: 0x6a552ced, ctime: 0x6a552ced, blocks: 0x8 00010000:00010000:2.0:1783966959.082731:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.082753:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1783966959.082758:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966959.082796:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.082818:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.082834:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.082842:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.082864:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783966959.083083:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3646:x1870624587927552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 440us (856us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783966959.083091:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1783966959.083309:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c3fd0000/2, rc 0, transno 4294967311 00000100:00100000:0.0:1783966959.083328:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587927552:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1783966959.083657:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783966959.083723:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1783966959.083738:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783966959.083751:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.083792:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783966959.083799:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.083831:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.083908:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587927808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783966959.083974:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966959.084033:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966959.084041:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587927680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783966959.084078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783966959.084182:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.084194:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a60beaf/0x9269c8b316067e14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.084219:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966959.084221:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966959.084224:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966959.084255:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587927808 00000100:00100000:2.0:1783966959.084265:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587927808 00000100:00100000:2.0:1783966959.085268:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587927680 00000100:00100000:2.0:1783966959.085276:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587927680 00000100:00100000:2.0:1783966959.085303:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966959.086495:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1870624587927808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783966959.086669:0:8714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783966959.086674:0:8714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783966958 00002000:00010000:2.0:1783966959.086676:0:8714:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783966959.086678:0:8714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783966958 -> 1783966958 00002000:00010000:2.0:1783966959.086680:0:8714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783966959.086766:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3648:x1870624587927808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1452us (2789us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783966959.086794:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783966959.086828:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783966959.086837:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1870624587927680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783966959.086852:0:8714:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1783966959.086871:0:8714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.086892:0:8714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.086901:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783966959.086906:0:8714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966959.086926:0:8714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.086970:0:8714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.086988:0:8714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 12 pid: 8432 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.087003:0:8714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587927936:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966959.087083:0:8714:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783966959.087961:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12464:x1870624563764864:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 9552us (12262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.087973:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 244 00000004:00080000:3.0:1783966959.088981:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c2683100/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783966959.088998:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587927808:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1783966959.090759:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1783966959.092656:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1783966959.092681:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1783966959.098243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.098518:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563764992 00000100:00100000:0.0:1783966959.098527:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563764992 00000100:00100000:0.0:1783966959.098590:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1783966959.098600:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2400:x1870624563764992:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783966959.098894:0:8714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8714:1870624587927936:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966959.098920:0:8714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.101875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.102308:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563765120 00000100:00100000:2.0:1783966959.102333:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563765120 00010000:00010000:2.0:1783966959.102523:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 14 pid: 8432 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.102576:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 104 00000100:00100000:2.0:1783966959.102586:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+14:2401:x1870624563765120:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966959.102603:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966959.102610:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 14 pid: 8432 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.102643:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 14 pid: 8432 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.102673:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316067bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6efc expref: 14 pid: 8432 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.102693:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966959.102698:0:9532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783966959.102705:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.102717:0:9532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.102846:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966959.102903:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+13:2401:x1870624563765120:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 318us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966959.102911:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 104 00000001:00080000:3.0:1783966959.105723:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1783966959.105738:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00010000:00010000:1.0:1783966959.105904:0:8714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.105919:0:8714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.105931:0:8714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.105939:0:8714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.105965:0:8714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783966959.106055:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966959.106063:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.106072:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783966959.106076:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.106111:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.106132:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.106140:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316067e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.106162:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966959.106164:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966959.106166:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966959.109570:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587927680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22728us (25483us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783966959.109585:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783966959.109668:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1783966959.109675:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1783966959.109694:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c2683100, transno 4294967322 00000100:00100000:2.0:1783966959.109715:0:3648:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a04c2683480 x1870624587927680/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783966975 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783966959.109726:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c2683480/2, rc 0, transno 4294967323 00000100:00100000:2.0:1783966959.109732:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587927680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783966959.110160:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563764992:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 11558us (11924us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.110168:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1783966959.118111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.120943:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563765376 00000100:00100000:2.0:1783966959.120963:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563765376 00000100:00100000:2.0:1783966959.121129:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00100000:2.0:1783966959.121155:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12464:x1870624563765376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783966959.121247:0:10203:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966959.121276:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067dff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f96 expref: 21 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.121313:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:2.0:1783966959.121602:0:10203:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783966959.121646:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.121661:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.121673:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783966959.121934:0:10203:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db8bfeb0 reply state 00000000c806b56c transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.121947:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.121955:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:2.0:1783966959.121957:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783966959.121960:0:10203:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783966959.122083:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12464:x1870624563765376:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 930us (3991us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1783966959.122838:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 245 00000100:00100000:3.0:1783966959.125356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.125453:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563765504 00000100:00100000:0.0:1783966959.125462:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563765504 00000100:00100000:0.0:1783966959.125514:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:0.0:1783966959.125523:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2401:x1870624563765504:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783966959.125685:0:14225:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783966959.125689:0:14225:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783966958 -> 1783966957 00002000:00010000:0.0:1783966959.125692:0:14225:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783966957 00002000:00010000:0.0:1783966959.125694:0:14225:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783966958 -> 1783966957 00002000:00010000:0.0:1783966959.125696:0:14225:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1783966959.125761:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2401:x1870624563765504:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 238us (413us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783966959.125812:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:3.0:1783966959.135013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.135246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563765760 00000100:00100000:2.0:1783966959.135256:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563765760 00000100:00100000:2.0:1783966959.135348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 246 00000100:00100000:2.0:1783966959.135360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:12464:x1870624563765760:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783966959.135451:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.135482:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.135492:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.135527:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.135541:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 22 pid: 6518 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.135554:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587928064:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966959.135660:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783966959.140747:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587928064:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966959.140831:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.145972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.146078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563765888 00000100:00100000:0.0:1783966959.146097:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563765888 00010000:00010000:0.0:1783966959.146146:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 23 pid: 6518 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.146194:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 105 00000100:00100000:0.0:1783966959.146205:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+23:2400:x1870624563765888:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966959.146219:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966959.146244:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 23 pid: 6518 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146261:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 23 pid: 6518 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146296:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e400/0x9269c8b316067de3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f88 expref: 23 pid: 6518 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146325:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:0.0:1783966959.146330:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146343:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146352:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.146397:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966959.146671:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2400:x1870624563765888:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 467us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.146680:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 105 00010000:00010000:2.0:1783966959.147821:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147834:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147876:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147884:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147904:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147911:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966959.147915:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147922:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147936:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:2.0:1783966959.147939:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783966959.147943:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.147949:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.148029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12464:x1870624563765760:12345-192.168.204.59@tcp:55:lhsmtool_posix.0 Request processed in 12668us (13025us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783966959.148039:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 246 00000100:00100000:3.0:1783966959.152880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.156522:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766016 00000100:00100000:1.0:1783966959.156541:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766016 00000100:00100000:1.0:1783966959.156653:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:1.0:1783966959.156665:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563766016:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783966959.156718:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.156741:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.156749:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783966959.156753:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783966959.156758:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.156828:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 8 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.156845:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 8 pid: 14225 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966959.156862:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1870624587928192:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783966959.156962:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c97f0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783966959.161667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.161845:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1870624587928192:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966959.161873:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.162083:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766144 00000100:00100000:3.0:1783966959.162092:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766144 00010000:00010000:3.0:1783966959.162136:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 9 pid: 14225 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.162180:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 106 00000100:00100000:3.0:1783966959.162189:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+9:2400:x1870624563766144:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966959.162206:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966959.162232:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 9 pid: 14225 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.162253:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 9 pid: 14225 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.162278:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316067e0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fa4 expref: 9 pid: 14225 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.162295:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966959.162300:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783966959.162307:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.162317:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.162348:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966959.162414:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2400:x1870624563766144:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 225us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966959.162422:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 106 00010000:00010000:0.0:1783966959.162494:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162515:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162539:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162548:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162556:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162564:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966959.162568:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162577:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162589:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.162598:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eff18a0/0x9269c8b316067e30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.162673:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563766016:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 6010us (9804us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.162682:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:3.0:1783966959.170707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.171897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766400 00000100:00100000:0.0:1783966959.171910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766400 00000100:00100000:0.0:1783966959.172077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 247 00000100:00100000:0.0:1783966959.172090:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:12464:x1870624563766400:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783966959.172546:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.172566:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.172578:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.172620:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.172634:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 21 pid: 6519 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.172649:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928320:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966959.172749:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966959.180149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.180166:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928320:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966959.180248:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.180634:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766528 00000100:00100000:3.0:1783966959.180654:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766528 00010000:00010000:3.0:1783966959.180710:0:13736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 22 pid: 6519 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.180761:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 107 00000100:00100000:3.0:1783966959.180813:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2401:x1870624563766528:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966959.180860:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966959.180870:0:13736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 22 pid: 6519 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180886:0:13736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 22 pid: 6519 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180915:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274f800/0x9269c8b316067d26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f50 expref: 22 pid: 6519 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180933:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966959.180939:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 21 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180951:0:13736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180958:0:13736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180966:0:13736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.180998:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783966959.181038:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.181050:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.181071:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:2401:x1870624563766528:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 298us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966959.181082:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 107 00010000:00010000:0.0:1783966959.181267:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.181300:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.181310:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.181356:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.181373:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 21 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.181389:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928448:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783966959.181496:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783966959.193221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966959.193879:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766656 00000100:00100000:3.0:1783966959.193892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766656 00010000:00010000:3.0:1783966959.193974:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 22 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966959.194036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:3.0:1783966959.194050:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2400:x1870624563766656:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966959.194070:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966959.194079:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 22 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.194106:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 22 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.194138:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:3.0:1783966959.194145:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.194157:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.194166:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.194194:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966959.194276:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2400:x1870624563766656:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 228us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966959.194285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00010000:00010000:0.0:1783966959.194745:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0000/0x9269c8b316067df1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f8f expref: 21 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.194937:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928448:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783966959.194995:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.195006:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.195012:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783966959.195299:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1783966959.195545:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1783966959.195590:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1783966959.195698:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587928576:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783966959.195804:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966959.195900:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd300 going to sleep for 11 seconds 00000100:00100000:2.0:1783966959.195949:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587928576 00000100:00100000:2.0:1783966959.195957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587928576 00000100:00100000:2.0:1783966959.196044:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783966959.196055:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1870624587928576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783966959.197056:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1870624587928576:12345-0@lo:1000:mdt00_001.0 Request processed in 997us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966959.197088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783966959.199541:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587928576:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1783966959.200001:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1783966959.200239:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587928704:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783966959.200417:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966959.200663:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd180 going to sleep for 11 seconds 00000100:00100000:0.0:1783966959.200758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587928704 00000100:00100000:0.0:1783966959.200767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587928704 00000100:00100000:0.0:1783966959.201052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783966959.201064:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1870624587928704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783966959.201290:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1870624587928704:12345-0@lo:1000:mdt00_001.0 Request processed in 226us (872us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783966959.201300:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783966959.201394:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6518:1870624587928704:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1783966959.201475:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201488:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201497:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201504:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966959.201509:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201516:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201538:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:1.0:1783966959.201541:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966959.201547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201555:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316067e3e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201612:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201619:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201626:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201630:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966959.201632:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201649:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201658:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966959.201661:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966959.201669:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201682:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201693:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.201728:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 24 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966959.201753:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928832:192.168.204.59@tcp:105: 00000100:00100000:1.0:1783966959.201885:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783966959.207101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.207756:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1870624587928832:192.168.204.59@tcp:105: 00010000:00010000:1.0:1783966959.207836:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207852:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316067d81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207903:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207921:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207935:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207948:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207955:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207961:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.207967:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966959.207971:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208001:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208017:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966959.208020:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966959.208025:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208031:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316067e45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208042:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208047:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208053:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208058:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783966959.208061:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208067:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208075:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966959.208078:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783966959.208081:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966959.208108:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1a00/0x9269c8b316067e37 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783966959.208356:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12464:x1870624563766400:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 36265us (37656us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783966959.208369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 247 00000020:00080000:1.0:1783966959.208378:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1783966959.208388:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563766784 00000100:00100000:2.0:1783966959.208399:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563766784 00000100:00100000:2.0:1783966959.208467:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1783966959.208479:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12463:x1870624563766784:12345-192.168.204.59@tcp:49:lfs.0 00000100:00100000:2.0:1783966959.208992:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12463:x1870624563766784:12345-192.168.204.59@tcp:49:lfs.0 Request processed in 438us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966959.209000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000040:00080000:3.0:1783966959.210309:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783966959.216158:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783966959.217418:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783966959.217445:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783966959.218175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.218359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.218452:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767296 00000100:00100000:1.0:1783966959.218466:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767296 00000100:00100000:1.0:1783966959.218553:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:1.0:1783966959.218565:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12463:x1870624563767296:12345-192.168.204.59@tcp:58:lfs.0 00000040:00080000:1.0:1783966959.218909:0:10203:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783966959.219148:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12463:x1870624563767296:12345-192.168.204.59@tcp:58:lfs.0 Request processed in 583us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.219158:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 248 00000100:00100000:2.0:1783966959.220235:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767040 00000100:00100000:2.0:1783966959.220249:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767040 00000100:00100000:2.0:1783966959.220383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1783966959.220396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+24:12464:x1870624563767040:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783966959.220988:0:6521:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783966959.221038:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1783966959.221090:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221224:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221241:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221252:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221258:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221295:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.221440:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783966959.221576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12464:x1870624563767040:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 1177us (3404us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783966959.221585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000020:00080000:2.0:1783966959.221593:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783966959.233862:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783966959.233884:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.233899:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783966959.234075:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.234088:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.234118:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:0.0:1783966959.234122:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783966959.234127:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.234135:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e4c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966959.234159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966959.234161:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966959.234164:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966959.264722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.264863:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767424 00000100:00100000:2.0:1783966959.264877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767424 00000100:00100000:2.0:1783966959.264953:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:2.0:1783966959.264966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+26:12466:x1870624563767424:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783966959.265018:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966959.265047:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265128:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265145:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265158:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265174:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265181:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265206:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265306:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265317:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265328:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265367:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 27 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.265383:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 27 pid: 7847 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.265401:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587928960:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783966959.265559:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783966959.270924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.273699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767680 00000100:00100000:0.0:1783966959.273720:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767680 00000100:00100000:0.0:1783966959.273871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783966959.273884:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:6173:x1870624563767680:12345-192.168.204.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783966959.274200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:6173:x1870624563767680:12345-192.168.204.59@tcp:35:ldlm_bl.0 Request processed in 318us (3292us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783966959.274209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1783966959.275003:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1870624587928960:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783966959.275040:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966959.284105:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.284335:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767808 00000100:00100000:2.0:1783966959.284350:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767808 00010000:00010000:2.0:1783966959.284411:0:9532:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 29 pid: 7847 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966959.284506:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:2.0:1783966959.284519:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:2401:x1870624563767808:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783966959.284541:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966959.284550:0:9532:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 29 pid: 7847 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284566:0:9532:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 29 pid: 7847 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284599:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0c00/0x9269c8b316067d73 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f6c expref: 29 pid: 7847 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284622:0:9532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966959.284630:0:9532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284643:0:9532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284653:0:9532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966959.284708:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783966959.286589:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286614:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783966959.286709:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783966959.286717:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783966959.286753:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286864:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286878:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286886:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286894:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286901:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966959.286906:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286915:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286936:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:3.0:1783966959.286962:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966959.286970:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.286978:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067e5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287002:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287008:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287015:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287020:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966959.287023:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287029:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287038:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a04c1cca700) 00010000:00010000:3.0:1783966959.287041:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966959.287044:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287050:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316067e61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287124:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631c00/0x9269c8b316067e53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fab expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287156:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fab expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966959.287165:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966959.287167:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783966959.287170:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:3.0:1783966959.287282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12466:x1870624563767424:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 22315us (22575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966959.287294:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 249 00000100:00100000:2.0:1783966959.288176:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:2401:x1870624563767808:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3651us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966959.288191:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00010000:00010000:1.0:1783966959.670931:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966959.892909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.892982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.893016:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966959.893020:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768320 00000100:00100000:0.0:1783966959.893031:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768320 00000100:00100000:2.0:1783966959.893060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.893084:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768064 00000100:00100000:2.0:1783966959.893090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.893091:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768064 00000100:00100000:2.0:1783966959.893120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966959.893145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966959.893177:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768576 00000100:00100000:1.0:1783966959.893182:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768576 00000100:00100000:1.0:1783966959.893211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768192 00000100:00100000:1.0:1783966959.893214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768192 00000100:00100000:1.0:1783966959.893226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768704 00000100:00100000:1.0:1783966959.893228:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768704 00000100:00100000:1.0:1783966959.893245:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 348 00000100:00100000:1.0:1783966959.893254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:2403:x1870624563768064:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966959.893344:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:2403:x1870624563768064:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 90us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.893352:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 348 00000100:00100000:1.0:1783966959.893372:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 349 00000100:00100000:1.0:1783966959.893379:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563768576:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966959.893408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563768576:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.893415:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 349 00000100:00100000:1.0:1783966959.893439:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 350 00000100:00100000:1.0:1783966959.893446:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563768192:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966959.893471:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563768192:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.893477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 350 00000100:00100000:1.0:1783966959.893489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 351 00000100:00100000:1.0:1783966959.893496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563768704:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966959.893520:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563768704:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.893526:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 351 00000100:00100000:1.0:1783966959.893545:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563767936 00000100:00100000:1.0:1783966959.893548:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563767936 00000100:00100000:1.0:1783966959.893573:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 394 00000100:00100000:1.0:1783966959.893579:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563767936:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:2.0:1783966959.893593:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783966959.893599:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966959.893607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563767936:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966959.893621:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 394 00000100:00100000:0.0:1783966959.893942:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768448 00000100:00100000:0.0:1783966959.893946:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768448 00000100:00100000:0.0:1783966959.894016:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1783966959.894024:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563768320:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966959.894079:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563768320:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 55us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.894086:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 99 00000100:00100000:0.0:1783966959.894099:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00100000:0.0:1783966959.894106:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563768448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966959.894129:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563768448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966959.894135:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 100 00000100:00080000:1.0:1783966959.898411:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1783966960.262496:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783966960.262508:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783966960.262565:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783966960.262577:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783966960.262790:0:13802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587929088:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783966960.262910:0:13802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3bb9180 going to sleep for 11 seconds 00000100:00100000:1.0:1783966960.266333:0:13802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1870624587929088:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783966960.287203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966960.287289:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563768832 00000100:00100000:0.0:1783966960.287303:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563768832 00000100:00100000:0.0:1783966960.287379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 250 00000100:00100000:0.0:1783966960.287390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12478:x1870624563768832:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783966960.287432:0:6518:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783966960.287558:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12478:x1870624563768832:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 168us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966960.287567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 250 00000100:00080000:0.0:1783966960.287590:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966960.297066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966960.297163:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563769088 00000100:00100000:1.0:1783966960.297175:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563769088 00000100:00100000:1.0:1783966960.297242:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:1.0:1783966960.297253:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+27:12478:x1870624563769088:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783966960.297273:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783966960.297293:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067e6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fb2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966960.297438:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067e76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966960.297452:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966960.297466:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067e76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783966960.297477:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783966960.297594:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e000/0x9269c8b316067e6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb2 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966960.297611:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067e76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb2 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966960.297620:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966960.297630:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966960.297634:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274ec00, rc 0) 00000100:00100000:1.0:1783966960.297704:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12478:x1870624563769088:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 453us (647us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783966960.297711:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 251 00000100:00100000:3.0:1783966960.309066:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966960.309104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966960.309138:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563769472 00000100:00100000:3.0:1783966960.309150:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563769472 00000100:00100000:3.0:1783966960.309227:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783966960.309239:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:2402:x1870624563769472:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966960.309257:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966960.309290:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ec00/0x9269c8b316067e76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb2 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966960.309314:0:13736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:3.0:1783966960.309320:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966960.309382:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:2402:x1870624563769472:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 145us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.309390:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1783966960.310005:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563769344 00000100:00100000:2.0:1783966960.310011:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563769344 00000100:00100000:2.0:1783966960.310056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 252 00000100:00100000:2.0:1783966960.310066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+28:12478:x1870624563769344:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783966960.310140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310155:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310166:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310331:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310339:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310346:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310352:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783966960.310364:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310373:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310384:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:2.0:1783966960.310386:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783966960.310390:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.310396:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631000/0x9269c8b316067e84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783966960.310519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12478:x1870624563769344:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 454us (1463us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783966960.310527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 252 00000040:00080000:0.0:1783966960.316242:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783966960.316259:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783966960.317020:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783966960.317031:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966960.318204:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966960.318280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563769728 00000100:00100000:0.0:1783966960.318292:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563769728 00000100:00100000:0.0:1783966960.318351:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:0.0:1783966960.318362:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+29:12478:x1870624563769728:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783966960.321044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:12478:x1870624563769728:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2669us (2836us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783966960.321059:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000040:00080000:2.0:1783966960.407238:0:14712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966960.407250:0:14712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966960.407282:0:14712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783966960.407308:0:14712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783966960.503318:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966960.503343:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587929472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966960.503563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966960.503684:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929472 00000100:00100000:3.0:1783966960.503694:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929472 00000100:00100000:3.0:1783966960.503791:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783966960.503802:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587929472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966960.505515:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966960.505632:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587929472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1828us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.505643:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783966960.505721:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587929472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966960.506028:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587929216:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783966960.506537:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966960.507003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966960.507060:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966960.507165:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929216 00000100:00100000:2.0:1783966960.507173:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929216 00000100:00100000:2.0:1783966960.507225:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783966960.507234:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1870624587929216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966960.507274:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1783966960.507327:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1870624587929216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966960.507334:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783966960.507996:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587929344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966960.508041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966960.508520:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587929216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966960.508733:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587929984:0@lo:400:kworker.0 00000100:00100000:0.0:1783966960.508797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966960.508819:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587930496:0@lo:400:kworker.0 00000100:00100000:2.0:1783966960.509048:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929984 00000100:00100000:2.0:1783966960.509056:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929984 00000100:00100000:2.0:1783966960.509178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783966960.509187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587929984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.509266:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929344 00000100:00100000:3.0:1783966960.509271:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929344 00000100:00100000:3.0:1783966960.509311:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783966960.509318:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587929344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783966960.509334:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966960.515890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587929984:12345-0@lo:400:kworker.0 Request processed in 6693us (7082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966960.516112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1783966960.516170:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966960.516203:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587929600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966960.516253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966960.516298:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587930112:0@lo:400:kworker.0 00000100:00100000:2.0:1783966960.516326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966960.516349:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587930624:0@lo:400:kworker.0 00000100:00100000:2.0:1783966960.516372:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966960.517280:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587929344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7959us (9234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.517291:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783966960.517313:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929600 00000100:00100000:3.0:1783966960.517320:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929600 00000100:00080000:3.0:1783966960.517349:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966960.517389:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783966960.517417:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587929600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966960.517448:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1783966960.517496:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587929600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.517502:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783966960.517555:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587929600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966960.517997:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587929856:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518043:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.518145:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587930368:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.518193:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587930880:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.518238:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783966960.518246:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587929728:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.518299:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587930240:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.518344:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587930752:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.518364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966960.519215:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1783966960.519224:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1783966960.519256:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3ea4000, transno 4294967308 00000004:00080000:1.0:1783966960.519273:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1783966960.519298:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c3fd0000, transno 4294967311 00000100:00100000:1.0:1783966960.519314:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587929344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783966960.519349:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930112 00000100:00100000:1.0:1783966960.519362:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930112 00000100:00100000:3.0:1783966960.519526:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929856 00000100:00100000:3.0:1783966960.519531:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929856 00000100:00100000:3.0:1783966960.519555:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930368 00000100:00100000:3.0:1783966960.519557:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930368 00000100:00100000:3.0:1783966960.519577:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930880 00000100:00100000:3.0:1783966960.519580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930880 00000100:00100000:3.0:1783966960.519592:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930752 00000100:00100000:3.0:1783966960.519595:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930752 00000100:00100000:3.0:1783966960.519610:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1783966960.519618:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587929856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.519691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587929856:12345-0@lo:400:kworker.0 Request processed in 74us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.519698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1783966960.519715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783966960.519721:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587930368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.519750:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587930368:12345-0@lo:400:kworker.0 Request processed in 30us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.519757:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783966960.519785:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783966960.519792:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587930880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.519821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587930880:12345-0@lo:400:kworker.0 Request processed in 30us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.519828:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783966960.520150:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1783966960.520158:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587930752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.520192:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587930752:12345-0@lo:400:kworker.0 Request processed in 35us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966960.520206:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1783966960.520225:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783966960.520230:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966960.521026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783966960.521037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587930112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.522042:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587930112:12345-0@lo:400:kworker.0 Request processed in 1004us (5710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966960.522054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783966960.522240:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587929728 00000100:00100000:1.0:1783966960.522250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587929728 00000100:00100000:1.0:1783966960.522301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1783966960.522309:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.522359:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587929728:12345-0@lo:400:kworker.0 Request processed in 51us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966960.522367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1783966960.522535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966960.522603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587929984:0@lo:400:kworker.0 00000100:00100000:0.0:1783966960.522632:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930496 00000100:00100000:0.0:1783966960.522636:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930496 00000100:00100000:0.0:1783966960.522676:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1783966960.522682:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587930496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966960.522735:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587930496:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966960.522743:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1783966960.522765:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930624 00000100:00100000:1.0:1783966960.523343:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587930240 00000100:00100000:1.0:1783966960.523351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930240 00000100:00100000:1.0:1783966960.523402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783966960.523419:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587930240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523469:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587930240:12345-0@lo:400:kworker.0 Request processed in 52us (5143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966960.523477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783966960.523517:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587929728:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523534:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587930240:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523549:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587930752:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523562:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587929856:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523573:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587930368:0@lo:400:kworker.0 00010000:00080000:1.0:1783966960.523603:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf1c00 x1870624587930880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783966960.523613:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587930880:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.523657:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587930112:0@lo:400:kworker.0 00000100:00080000:1.0:1783966960.527523:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966960.529076:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587930624 00000100:00100000:0.0:1783966960.529190:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783966960.529206:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587930624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966960.529335:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587930624:12345-0@lo:400:kworker.0 Request processed in 133us (12961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966960.529343:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1783966960.529424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56eb480 x1870624587930496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966960.529441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587930496:0@lo:400:kworker.0 00000100:00100000:1.0:1783966960.530164:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587930624:0@lo:400:kworker.0 00000100:00100000:3.0:1783966960.637380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966960.640036:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563769984 00000100:00100000:0.0:1783966960.640050:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563769984 00000100:00100000:0.0:1783966960.640139:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:0.0:1783966960.640151:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+30:12491:x1870624563769984:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783966960.640179:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783966960.640222:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fb9 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.640352:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067e92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.640369:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067e92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.640589:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067e92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783966960.640605:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783966960.640706:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0000/0x9269c8b316067e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb9 expref: 33 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.640724:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067e92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb9 expref: 32 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.640733:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966960.640736:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783966960.640739:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783966960.640829:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:12491:x1870624563769984:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 680us (3461us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1783966960.640837:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 253 00000100:00100000:3.0:1783966960.643747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966960.643884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770112 00000100:00100000:0.0:1783966960.643896:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770112 00000100:00100000:0.0:1783966960.644102:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 254 00000100:00100000:0.0:1783966960.644113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:12491:x1870624563770112:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:0.0:1783966960.644208:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644228:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644242:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644319:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644327:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644334:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644340:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783966960.644344:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644352:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644367:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:0.0:1783966960.644371:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783966960.644376:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966960.644383:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316067ea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783966960.645566:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+32:12491:x1870624563770112:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 1443us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966960.645582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 254 00010000:00010000:2.0:1783966960.695259:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966960.818972:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966960.819432:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770240 00000100:00100000:2.0:1783966960.819444:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770240 00000100:00100000:2.0:1783966960.819529:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:2.0:1783966960.819540:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563770240:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1783966960.819559:0:14225:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1783966960.820845:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783966960.821481:0:14225:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316067ea7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fc0 expref: -99 pid: 14225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783966960.821541:0:14225:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a552ced, atime: 0x6a552ced, ctime: 0x6a552ced, blocks: 0x8 00010000:00010000:2.0:1783966960.821571:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1783966960.821645:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783966960.821658:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316067ea7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc0 expref: 8 pid: 14225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.821681:0:14225:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316067ea7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc0 expref: 8 pid: 14225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966960.821698:0:14225:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631000, rc 0) 00000100:00100000:2.0:1783966960.821801:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2402:x1870624563770240:12345-192.168.204.59@tcp:101:cat.0 Request processed in 2233us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966960.821810:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1783966960.827099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966960.827256:0:14673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770368 00000100:00100000:1.0:1783966960.827266:0:14673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770368 00002000:00100000:1.0:1783966960.827332:0:14673:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9a04c1cf2680 x1870624563770368/t0(0) o3->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:121/0 lens 488/0 e 0 to 0 dl 1783966971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783966960.827345:0:14673:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c1cf2680 with x1870624563770368 ext(0->4095) 00002000:00010000:1.0:1783966960.827350:0:14673:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c1cf2680 00000100:00100000:1.0:1783966960.827392:0:14673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1783966960.827412:0:14673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2403:x1870624563770368:12345-192.168.204.59@tcp:3:cat.0 00000100:00100000:1.0:1783966960.827821:0:14673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+8:2403:x1870624563770368:12345-192.168.204.59@tcp:3:cat.0 Request processed in 418us (730us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783966960.827829:0:14673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00002000:00100000:1.0:1783966960.827837:0:14673:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9a04c1cf2680 x1870624563770368/t0(0) o3->4272c10e-7366-407e-b067-e3d2ea5c5b05@192.168.204.59@tcp:121/0 lens 488/4536 e 0 to 0 dl 1783966971 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783966960.827845:0:14673:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c1cf2680 with x1870624563770368 ext(0->4095) 00002000:00010000:1.0:1783966960.827849:0:14673:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c1cf2680 00000100:00100000:0.0:1783966961.015052:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587931008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966961.015151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966961.015409:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931008 00000100:00100000:3.0:1783966961.015417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931008 00000100:00100000:3.0:1783966961.015480:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1783966961.015490:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587931008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783966961.015539:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783966961.015598:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587931008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966961.015605:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783966961.015800:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587931008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783966961.725191:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966962.753684:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783966963.395342:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783966963.395364:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783966963.395387:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783966963.395394:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783966963.767187:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783966963.831512:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783966964.100607:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587931136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966964.100716:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966964.103599:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931136 00000100:00100000:1.0:1783966964.103615:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931136 00000100:00100000:1.0:1783966964.103673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783966964.103683:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587931136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966964.103724:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966964.104548:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587931136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 862us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966964.104558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783966964.104868:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587931136:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1783966964.604847:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1783966964.604892:0:6497:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05c97f0600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783966964.604897:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05c97f0000 00000020:00080000:1.0:1783966964.604901:0:6497:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a05f5656700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c371ce00 00000020:00080000:1.0:1783966964.604930:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783966964.604982:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1783966964.605074:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1783966964.606657:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1783966964.606679:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1783966964.606867:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.606889:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.606897:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.606905:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783966964.606912:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.607388:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.607499:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a05f5465b00) 00010000:00010000:3.0:1783966964.607502:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783966964.607509:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966964.607517:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316067e22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966964.791092:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966965.009558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.009704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.009794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.009817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966965.012862:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771008 00000100:00100000:3.0:1783966965.012884:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771008 00000100:00100000:3.0:1783966965.013001:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1783966965.013016:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563771008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783966965.013127:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563771008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 115us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966965.013136:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00080000:3.0:1783966965.013172:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783966965.015990:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770496 00000100:00100000:1.0:1783966965.016008:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770496 00000100:00100000:1.0:1783966965.016088:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 396 00000100:00100000:1.0:1783966965.016101:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563770496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966965.024160:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770752 00000100:00100000:2.0:1783966965.024180:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770752 00000100:00080000:2.0:1783966965.024233:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966965.024374:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771264 00000100:00100000:2.0:1783966965.024378:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771264 00000100:00100000:2.0:1783966965.024418:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 358 00000100:00100000:2.0:1783966965.024428:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563770752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966965.024565:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2402:x1870624563770496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8464us (15015us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966965.024576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 396 00000100:00100000:1.0:1783966965.024843:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 359 00000100:00100000:1.0:1783966965.024853:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563771264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966965.024892:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563771264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 41us (15074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966965.024917:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 359 00000100:00100000:0.0:1783966965.029011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.029067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.029120:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770880 00000100:00100000:0.0:1783966965.029132:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770880 00000100:00100000:0.0:1783966965.029203:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:0.0:1783966965.029216:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563770880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966965.029333:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2402:x1870624563770880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.029343:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:0.0:1783966965.029397:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966965.029456:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563770624 00000100:00100000:0.0:1783966965.029461:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563770624 00000100:00100000:0.0:1783966965.029487:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771136 00000100:00100000:0.0:1783966965.029490:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771136 00000100:00100000:0.0:1783966965.029505:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 360 00000100:00100000:0.0:1783966965.029510:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2402:x1870624563770624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966965.029556:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2402:x1870624563770624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 44us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.029563:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 360 00000100:00100000:0.0:1783966965.029576:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 361 00000100:00100000:0.0:1783966965.029598:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563771136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966965.029624:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2402:x1870624563771136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.029631:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 361 00000100:00100000:2.0:1783966965.030808:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2402:x1870624563770752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 6371us (21093us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.030821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 358 00000100:00080000:2.0:1783966965.030854:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966965.030861:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966965.030864:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966965.623318:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587931392:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.623414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.623738:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587931648:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624363:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587932160:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624424:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587932672:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624489:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783966965.624497:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587931520:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624591:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587932032:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624615:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624634:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587932544:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624656:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966965.624765:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587931904:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624810:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931392 00000100:00100000:2.0:1783966965.624822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931392 00000100:00100000:0.0:1783966965.624842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624875:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931648 00000100:00100000:0.0:1783966965.624882:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587932416:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.624883:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931648 00000100:00100000:2.0:1783966965.624914:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932032 00000100:00100000:2.0:1783966965.624920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932032 00000100:00100000:0.0:1783966965.624927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.624967:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932544 00000100:00100000:2.0:1783966965.624974:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932544 00000100:00100000:0.0:1783966965.624977:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966965.624993:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931904 00000100:00100000:2.0:1783966965.624998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931904 00000100:00100000:2.0:1783966965.625013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932416 00000100:00100000:2.0:1783966965.625015:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932416 00000100:00100000:2.0:1783966965.625032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1783966965.625040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587931392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625094:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587931392:12345-0@lo:400:kworker.0 Request processed in 54us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1783966965.625115:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1783966965.625120:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587931648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625148:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587931648:12345-0@lo:400:kworker.0 Request processed in 28us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625153:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1783966965.625165:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1783966965.625171:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587932032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625195:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587932032:12345-0@lo:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1783966965.625211:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783966965.625216:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587932544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625253:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587932544:12345-0@lo:400:kworker.0 Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625259:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1783966965.625272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1783966965.625277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587931904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625306:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587931904:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.625322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.625331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1783966965.625347:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1783966965.625354:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587932416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.625380:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587931392:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625388:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587932416:12345-0@lo:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625395:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783966965.625398:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587931904:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.625413:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587932416:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625422:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932160 00000100:00100000:2.0:1783966965.625428:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932160 00000100:00100000:2.0:1783966965.625461:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932672 00000100:00100000:2.0:1783966965.625465:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932672 00000100:00100000:2.0:1783966965.625485:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783966965.625491:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587932160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625524:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587932160:12345-0@lo:400:kworker.0 Request processed in 32us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625531:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783966965.625542:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783966965.625548:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587932672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625574:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587932672:12345-0@lo:400:kworker.0 Request processed in 26us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625589:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783966965.625599:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1783966965.625611:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587931264:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625617:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931520 00000100:00100000:2.0:1783966965.625622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931520 00000100:00100000:2.0:1783966965.625655:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783966965.625656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.625665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587931520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.625695:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587931776:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.625709:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587931520:12345-0@lo:400:kworker.0 Request processed in 44us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783966965.625729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783966965.625752:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966965.625756:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932288:0@lo:400:kworker.0 00000100:00080000:2.0:1783966965.625758:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783966965.625763:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783966965.625766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966965.625806:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587933056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966965.625834:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.625869:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932928 00000100:00100000:2.0:1783966965.625873:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932928 00000100:00100000:2.0:1783966965.625901:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933056 00000100:00100000:2.0:1783966965.625904:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933056 00000100:00100000:2.0:1783966965.625916:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783966965.625922:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783966965.625945:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783966965.625979:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.625985:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783966965.625997:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783966965.626003:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587933056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966965.626017:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966965.626057:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587933056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.626063:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1783966965.626076:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966965.626116:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587933056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966965.626145:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587931520:0@lo:400:kworker.0 00010000:00080000:2.0:1783966965.626158:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf1c00 x1870624587932032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966965.626169:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587932032:0@lo:400:kworker.0 00010000:00080000:2.0:1783966965.626180:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a9f80 x1870624587932544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966965.626189:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587932544:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626199:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587931648:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626210:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587932160:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626219:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587932672:0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626272:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931264 00000100:00100000:2.0:1783966965.626275:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931264 00000100:00100000:2.0:1783966965.626302:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1783966965.626324:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587931264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587931264:12345-0@lo:400:kworker.0 Request processed in 50us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.626365:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1783966965.626607:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966965.626622:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587933184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966965.626646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.626670:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933184 00000100:00100000:2.0:1783966965.626674:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933184 00000100:00100000:2.0:1783966965.626693:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783966965.626699:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587933184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966965.626708:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783966965.626734:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587933184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.626739:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783966965.626765:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587933184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966965.626827:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587931776 00000100:00100000:2.0:1783966965.626831:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587931776 00000100:00100000:2.0:1783966965.626849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1783966965.626855:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587931776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966965.626888:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587931776:12345-0@lo:400:kworker.0 Request processed in 32us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.626894:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783966965.627343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966965.627381:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932800:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.627406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966965.627548:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1783966965.627556:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c2683480, transno 4294967323 00000004:00080000:0.0:1783966965.627570:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1783966965.627607:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966965.627627:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587931264:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.627638:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587931776:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.627665:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932288 00000100:00100000:0.0:1783966965.627669:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932288 00000100:00100000:0.0:1783966965.627706:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587932800 00000100:00100000:0.0:1783966965.627710:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587932800 00000100:00100000:0.0:1783966965.627737:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783966965.627744:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.627804:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932288:12345-0@lo:400:kworker.0 Request processed in 59us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.627997:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783966965.628014:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783966965.628021:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.628372:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587932800:12345-0@lo:400:kworker.0 Request processed in 351us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966965.628379:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1783966965.628406:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966965.628513:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932288:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.628528:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587932800:0@lo:400:kworker.0 00000100:00100000:0.0:1783966965.634226:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966965.634253:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587933312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966965.634341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966965.634416:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933312 00000100:00100000:2.0:1783966965.634427:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933312 00000100:00100000:2.0:1783966965.634489:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783966965.634500:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587933312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966965.634536:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966965.634584:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587933312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966965.634591:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783966965.634896:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587933312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783966965.814955:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966966.136295:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783966966.136339:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587933440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783966966.136443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966966.136536:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933440 00000100:00100000:1.0:1783966966.136548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933440 00000100:00100000:1.0:1783966966.136673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966966.136686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587933440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783966966.136735:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783966966.136820:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587933440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966966.136829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783966966.137117:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587933440:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783966966.849937:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966967.011670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966967.011870:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771392 00000100:00100000:2.0:1783966967.011891:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771392 00000100:00100000:2.0:1783966967.011983:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 255 00000100:00100000:2.0:1783966967.011996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:12152:x1870624563771392:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783966967.012159:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:12152:x1870624563771392:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 166us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966967.012169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 255 00000100:00080000:0.0:1783966967.013291:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783966967.014574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966967.014692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771520 00000100:00100000:2.0:1783966967.014705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771520 00000100:00080000:0.0:1783966967.014898:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966967.015133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 256 00000100:00100000:2.0:1783966967.015148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:12152:x1870624563771520:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783966967.015362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:12152:x1870624563771520:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 217us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966967.015371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 256 00000100:00100000:1.0:1783966967.022345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966967.022472:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771776 00000100:00100000:0.0:1783966967.022498:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771776 00000100:00100000:0.0:1783966967.022620:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:0.0:1783966967.022634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:12152:x1870624563771776:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783966967.026855:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:12152:x1870624563771776:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 4204us (4508us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1783966967.026889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:1.0:1783966967.340920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966967.341059:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563771904 00000100:00100000:2.0:1783966967.341073:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563771904 00000100:00100000:2.0:1783966967.341181:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 257 00000100:00100000:2.0:1783966967.341195:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:12950:x1870624563771904:12345-192.168.204.59@tcp:101:lsof.0 00010000:00010000:2.0:1783966967.341223:0:10203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783966967.341255:0:10203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fc7 expref: -99 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341369:0:10203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341392:0:10203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341433:0:10203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783966967.341511:0:10203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783966967.341515:0:10203:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783966967.341550:0:10203:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341584:0:10203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316067eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc7 expref: 7 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341611:0:10203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc7 expref: 6 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966967.341620:0:10203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:2.0:1783966967.341623:0:10203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783966967.341627:0:10203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630a00, rc 0) 00000100:00100000:2.0:1783966967.341877:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:12950:x1870624563771904:12345-192.168.204.59@tcp:101:lsof.0 Request processed in 684us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966967.341884:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 257 00000100:00080000:0.0:1783966967.342104:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783966967.863133:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966968.887023:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966969.207279:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783966969.207324:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587933568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783966969.207449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966969.207729:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933568 00000100:00100000:1.0:1783966969.207751:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933568 00000100:00100000:1.0:1783966969.207862:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783966969.207874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587933568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966969.207931:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966969.211221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587933568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3329us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966969.211255:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783966969.212668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587933568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783966969.912315:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966970.121208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966970.121275:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966970.121333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966970.121650:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772544 00000100:00100000:2.0:1783966970.121663:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772544 00000100:00100000:2.0:1783966970.121755:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:2.0:1783966970.121806:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563772544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966970.121910:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563772544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 143us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.121937:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 108 00000100:00100000:1.0:1783966970.122475:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772032 00000100:00100000:1.0:1783966970.122497:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772032 00000100:00100000:1.0:1783966970.122551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 398 00000100:00100000:1.0:1783966970.122560:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563772032:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966970.122606:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2400:x1870624563772032:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 47us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966970.122613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 398 00000100:00080000:3.0:1783966970.123491:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966970.123587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772288 00000100:00100000:0.0:1783966970.123597:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772288 00000100:00100000:0.0:1783966970.123690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 368 00000100:00100000:0.0:1783966970.123702:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563772288:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966970.123804:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2400:x1870624563772288:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 71us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.123814:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 368 00000100:00080000:3.0:1783966970.124429:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966970.135218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966970.135280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966970.135626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772800 00000100:00100000:2.0:1783966970.135642:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772800 00000100:00100000:2.0:1783966970.135738:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772160 00000100:00100000:0.0:1783966970.136113:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 369 00000100:00100000:0.0:1783966970.136129:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563772800:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966970.136258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772160 00000100:00100000:2.0:1783966970.136294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 370 00000100:00100000:2.0:1783966970.136302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:2400:x1870624563772160:12345-192.168.204.59@tcp:400:kworker.0 00000100:00080000:3.0:1783966970.136374:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966970.136380:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966970.136652:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2400:x1870624563772800:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 527us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.136661:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 369 00000100:00100000:2.0:1783966970.136730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:2400:x1870624563772160:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 429us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.136737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 370 00000100:00100000:1.0:1783966970.137044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966970.137169:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966970.143410:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772672 00000100:00100000:2.0:1783966970.143435:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772672 00000100:00100000:2.0:1783966970.143577:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 371 00000100:00100000:2.0:1783966970.143591:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2400:x1870624563772672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966970.143717:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2400:x1870624563772672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 127us (6546us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.143726:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 371 00000100:00080000:3.0:1783966970.143887:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966970.144330:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772416 00000100:00100000:0.0:1783966970.144338:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772416 00000100:00100000:0.0:1783966970.144526:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00100000:0.0:1783966970.144537:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563772416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966970.144593:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2400:x1870624563772416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 59us (7549us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.144601:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 109 00000100:00080000:3.0:1783966970.151159:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966970.743178:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587933696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966970.743333:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.743467:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587934208:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.743511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.743544:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587934720:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.743557:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934208 00000100:00100000:2.0:1783966970.743580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.743601:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587935232:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.743655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.743684:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1783966970.743691:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587934080:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.743718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.743722:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934208 00000100:00100000:2.0:1783966970.743744:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587934592:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.743811:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.743844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783966970.743855:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587935104:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.743864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587934208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.743892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.743963:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587933824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966970.743995:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587934208:12345-0@lo:400:kworker.0 Request processed in 137us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.744014:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783966970.744019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.744055:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587934336:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.744060:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934720 00000100:00100000:0.0:1783966970.744067:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934720 00000100:00100000:2.0:1783966970.744089:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.744112:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587934848:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.744113:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935232 00000100:00100000:0.0:1783966970.744122:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935232 00000100:00100000:0.0:1783966970.744148:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934080 00000100:00100000:0.0:1783966970.744152:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934080 00000100:00100000:2.0:1783966970.744160:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.744179:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934592 00000100:00100000:2.0:1783966970.744190:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587935360:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.744200:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934592 00000100:00100000:2.0:1783966970.744234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.744243:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935104 00000100:00100000:0.0:1783966970.744250:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935104 00000100:00100000:2.0:1783966970.744268:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783966970.744276:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934336 00000100:00100000:2.0:1783966970.744279:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587933952:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.744300:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934336 00000100:00100000:2.0:1783966970.744321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.744330:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1783966970.744347:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587934720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.744370:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587934464:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.744424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966970.744427:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587934720:12345-0@lo:400:kworker.0 Request processed in 78us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.744436:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1783966970.744464:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587934976:0@lo:400:kworker.0 00000100:00100000:0.0:1783966970.744477:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1783966970.744491:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587935232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.744510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.744576:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933696 00000100:00100000:2.0:1783966970.744594:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933696 00000100:00100000:2.0:1783966970.744645:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933824 00000100:00100000:2.0:1783966970.744649:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933824 00000100:00100000:2.0:1783966970.744666:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783966970.744674:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587933696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783966970.744712:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966970.744762:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587933696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.744797:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783966970.744814:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783966970.744821:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587933824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966970.744831:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966970.744862:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587933824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.744869:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783966970.744919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1783966970.744927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587934080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.744962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587934080:12345-0@lo:400:kworker.0 Request processed in 37us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.744968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1783966970.744985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783966970.744991:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587934592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745024:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587934592:12345-0@lo:400:kworker.0 Request processed in 32us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1783966970.745048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1783966970.745065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587935104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745104:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587935104:12345-0@lo:400:kworker.0 Request processed in 43us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745111:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1783966970.745144:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1783966970.745154:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587934336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745193:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587934336:12345-0@lo:400:kworker.0 Request processed in 42us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1783966970.745259:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934848 00000100:00100000:2.0:1783966970.745266:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934848 00000100:00080000:3.0:1783966970.745314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966970.745316:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935360 00000100:00100000:2.0:1783966970.745322:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935360 00000100:00080000:3.0:1783966970.745325:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966970.745333:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966970.745338:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966970.745347:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934976 00000100:00100000:2.0:1783966970.745352:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934976 00000100:00100000:3.0:1783966970.745375:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587935488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966970.745386:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783966970.745395:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587934848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966970.745452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.745463:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587934848:12345-0@lo:400:kworker.0 Request processed in 66us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745472:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783966970.745496:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783966970.745504:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587935360:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783966970.745528:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966970.745553:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587935360:12345-0@lo:400:kworker.0 Request processed in 47us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966970.745554:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935488 00000100:00100000:2.0:1783966970.745564:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783966970.745578:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966970.745585:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587934976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745625:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587934976:12345-0@lo:400:kworker.0 Request processed in 40us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745631:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783966970.745668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587934464 00000100:00100000:2.0:1783966970.745672:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587934464 00000100:00100000:2.0:1783966970.745691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783966970.745696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587934464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745725:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587934464:12345-0@lo:400:kworker.0 Request processed in 29us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.745731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1783966970.745797:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587934464:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745810:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587934976:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587933824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783966970.745840:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587934336:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745850:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587934848:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.745858:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587935360:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.746042:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587933952 00000100:00100000:2.0:1783966970.746047:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587933952 00000100:00100000:2.0:1783966970.746078:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1783966970.746085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587933952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.746131:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587933952:12345-0@lo:400:kworker.0 Request processed in 47us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966970.746138:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1783966970.746186:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587933952:0@lo:400:kworker.0 00000100:00100000:3.0:1783966970.746406:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935488 00000100:00100000:3.0:1783966970.746546:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783966970.746556:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587935488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783966970.746588:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783966970.746657:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587935488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966970.746664:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783966970.746724:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587935488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966970.747490:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587935232:12345-0@lo:400:kworker.0 Request processed in 70us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966970.747504:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1783966970.748354:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587935616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966970.752143:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587934080:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.752228:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587934592:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.752248:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587935104:0@lo:400:kworker.0 00000100:00100000:2.0:1783966970.752265:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587934208:0@lo:400:kworker.0 00010000:00080000:2.0:1783966970.752288:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a9c00 x1870624587934720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966970.752300:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587934720:0@lo:400:kworker.0 00010000:00080000:2.0:1783966970.752319:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1cf1180 x1870624587935232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966970.752329:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587935232:0@lo:400:kworker.0 00000100:00100000:3.0:1783966970.752345:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966970.752377:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587933696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783966970.756714:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935616 00000100:00100000:3.0:1783966970.756731:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935616 00000100:00100000:3.0:1783966970.757577:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783966970.757592:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587935616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966970.757628:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783966970.757725:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587935616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (9304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966970.757750:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783966970.758785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587935616:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1783966970.762910:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1783966970.762930:0:6497:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783966970.763121:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1783966970.763146:0:6550:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1783966970.940324:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966971.258198:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587935744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966971.258325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966971.258604:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935744 00000100:00100000:0.0:1783966971.258615:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935744 00000100:00100000:0.0:1783966971.258697:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783966971.258712:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587935744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783966971.258811:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783966971.258894:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587935744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966971.258903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1783966971.261713:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587935744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966971.965235:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783966972.378719:0:14909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:22:49 (1783966969) 00010000:00010000:3.0:1783966972.984162:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783966973.050513:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1783966973.635326:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783966973.635338:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783966973.635459:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783966973.635466:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783966974.007554:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966974.327270:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966974.327297:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587935872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783966974.327372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966974.327440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587935872 00000100:00100000:1.0:1783966974.327448:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587935872 00000100:00100000:1.0:1783966974.327504:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783966974.327513:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587935872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966974.327547:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966974.327594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587935872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966974.327600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783966974.327641:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587935872:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783966975.036215:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966975.233231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233538:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966975.233584:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773184 00000100:00100000:1.0:1783966975.233596:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773184 00000100:00100000:1.0:1783966975.233681:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773696 00000100:00100000:1.0:1783966975.233685:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773696 00000100:00100000:1.0:1783966975.233700:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773056 00000100:00100000:1.0:1783966975.233703:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773056 00000100:00100000:1.0:1783966975.233715:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773568 00000100:00100000:1.0:1783966975.233718:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773568 00000100:00100000:1.0:1783966975.233740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 378 00000100:00100000:1.0:1783966975.233752:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563773184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783966975.233881:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563773184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 132us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966975.233891:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 378 00000100:00100000:0.0:1783966975.234035:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773440 00000100:00100000:0.0:1783966975.234041:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773440 00000100:00100000:0.0:1783966975.234078:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773312 00000100:00100000:0.0:1783966975.234091:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773312 00000100:00100000:0.0:1783966975.234120:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:0.0:1783966975.234138:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563773440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966975.234174:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2403:x1870624563773440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.234182:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 113 00000100:00100000:0.0:1783966975.234196:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:0.0:1783966975.234203:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563773312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966975.234228:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2403:x1870624563773312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.234235:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 114 00000100:00100000:0.0:1783966975.234257:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 379 00000100:00100000:0.0:1783966975.234264:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563773696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966975.234292:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2403:x1870624563773696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.234298:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 379 00000100:00100000:0.0:1783966975.234314:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 380 00000100:00100000:0.0:1783966975.234320:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2403:x1870624563773056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966975.234349:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:2403:x1870624563773056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.234355:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 380 00000100:00100000:0.0:1783966975.234367:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 381 00000100:00100000:0.0:1783966975.234372:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2403:x1870624563773568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783966975.234412:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2403:x1870624563773568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.234419:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 381 00000100:00080000:3.0:1783966975.236870:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783966975.236885:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966975.236890:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966975.236893:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783966975.241554:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563772928 00000100:00100000:2.0:1783966975.241577:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563772928 00000100:00100000:2.0:1783966975.242223:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 400 00000100:00100000:2.0:1783966975.242241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563772928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783966975.242391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2403:x1870624563772928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 155us (9176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966975.242400:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 400 00000100:00100000:0.0:1783966975.863561:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587936128:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.863665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.863752:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587936640:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.863795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966975.863800:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587936000:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.863820:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587937152:0@lo:400:kworker.0 00000100:00100000:3.0:1783966975.863926:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587936384:0@lo:400:kworker.0 00000100:00100000:1.0:1783966975.864018:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936128 00000100:00100000:1.0:1783966975.864027:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936128 00000100:00100000:1.0:1783966975.864091:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936640 00000100:00100000:1.0:1783966975.864096:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936640 00000100:00100000:1.0:1783966975.864150:0:10203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1783966975.864160:0:10203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587936128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.864816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.864874:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783966975.864884:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587936256:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.864918:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.864937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587936768:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.864960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.864970:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587937280:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.864990:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.865022:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936256 00000100:00100000:0.0:1783966975.865027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936256 00000100:00100000:0.0:1783966975.865069:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783966975.865077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587936256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.868873:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587936256:12345-0@lo:400:kworker.0 Request processed in 3776us (3934us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.868897:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783966975.868979:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937152 00000100:00100000:0.0:1783966975.869014:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937152 00000100:00100000:0.0:1783966975.869065:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936768 00000100:00100000:0.0:1783966975.869068:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936768 00000100:00100000:0.0:1783966975.869085:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937280 00000100:00100000:0.0:1783966975.869088:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937280 00000100:00100000:0.0:1783966975.869105:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783966975.869114:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587936640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869208:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587936640:12345-0@lo:400:kworker.0 Request processed in 95us (5412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.869215:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1783966975.869230:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783966975.869236:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587937152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869267:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587937152:12345-0@lo:400:kworker.0 Request processed in 31us (4453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.869272:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783966975.869283:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1783966975.869289:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587936768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869317:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587936768:12345-0@lo:400:kworker.0 Request processed in 28us (4357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.869323:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1783966975.869333:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1783966975.869339:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587937280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869366:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587937280:12345-0@lo:400:kworker.0 Request processed in 27us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.869530:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1783966975.869603:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587936256:0@lo:400:kworker.0 00010000:00080000:0.0:1783966975.869641:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e13800 x1870624587936768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966975.869655:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587936768:0@lo:400:kworker.0 00010000:00080000:0.0:1783966975.869669:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e11880 x1870624587937280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966975.869678:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587937280:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869693:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587936640:0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.869718:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587937152:0@lo:400:kworker.0 00000100:00080000:0.0:1783966975.869817:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966975.869823:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783966975.870149:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587937792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966975.870206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.870246:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966975.870253:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587937664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966975.870276:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966975.870308:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937792 00000100:00100000:0.0:1783966975.870315:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937792 00000100:00100000:0.0:1783966975.870359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937664 00000100:00100000:0.0:1783966975.870362:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937664 00000100:00100000:0.0:1783966975.870392:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783966975.870401:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587937792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966975.870433:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966975.870477:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587937792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.870497:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783966975.870511:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783966975.870518:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587937664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783966975.870529:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966975.870553:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587937664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.870559:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1783966975.870574:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783966975.870603:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587937664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966975.870617:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587937792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783966975.874344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966975.874469:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587936512:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.874560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966975.874606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936512 00000100:00100000:2.0:1783966975.874616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936512 00000100:00100000:2.0:1783966975.875740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783966975.875758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587936512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.878461:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587936512:12345-0@lo:400:kworker.0 Request processed in 2693us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966975.878483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783966975.878599:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587936512:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.878617:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587937024:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.879454:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966975.879529:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937024 00000100:00100000:2.0:1783966975.879538:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937024 00000100:00100000:2.0:1783966975.879617:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783966975.879627:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587937024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.880287:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936000 00000100:00100000:0.0:1783966975.880294:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936000 00000100:00100000:0.0:1783966975.880341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1783966975.880348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587936000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.880431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3646:x1870624587936000:12345-0@lo:400:kworker.0 Request processed in 83us (6099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.880439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00080000:0.0:1783966975.880510:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966975.881326:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587937024:12345-0@lo:400:kworker.0 Request processed in 1486us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966975.881359:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783966975.881421:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587937024:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.881435:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587937536:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.881471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966975.881505:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937536 00000100:00100000:2.0:1783966975.881510:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937536 00000100:00100000:2.0:1783966975.881549:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783966975.881557:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587937536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.881591:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587937536:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966975.881598:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783966975.881624:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587937536:0@lo:400:kworker.0 00000100:00100000:3.0:1783966975.881860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966975.881889:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587936896:0@lo:400:kworker.0 00000100:00100000:3.0:1783966975.881915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966975.881938:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587937408:0@lo:400:kworker.0 00000100:00100000:3.0:1783966975.881960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966975.881988:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587937920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966975.882010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966975.882031:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966975.882037:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587938048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783966975.882058:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966975.882088:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937920 00000100:00100000:3.0:1783966975.882092:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937920 00000100:00100000:0.0:1783966975.882326:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936896 00000100:00100000:0.0:1783966975.882332:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936896 00000100:00100000:0.0:1783966975.882365:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587937408 00000100:00100000:3.0:1783966975.882612:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938048 00000100:00100000:3.0:1783966975.882616:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938048 00000100:00100000:3.0:1783966975.882635:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783966975.882656:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587937920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783966975.882693:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783966975.882793:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587937408 00000100:00100000:0.0:1783966975.882822:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783966975.882829:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587936896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966975.882894:0:10203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587936128:12345-0@lo:400:kworker.0 Request processed in 18733us (19227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966975.882904:0:10203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1783966975.883023:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624587936896:12345-0@lo:400:kworker.0 Request processed in 193us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.883036:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783966975.883050:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783966975.883056:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587937408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.883086:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587937408:12345-0@lo:400:kworker.0 Request processed in 31us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.883093:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783966975.883133:0:10203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587936384 00000100:00100000:0.0:1783966975.883137:0:10203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587936384 00000100:00100000:0.0:1783966975.883172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1783966975.883179:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587936384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966975.883212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587936384:12345-0@lo:400:kworker.0 Request processed in 34us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.883218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1783966975.883262:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783966975.883269:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587938048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966975.883281:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783966975.883307:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587938048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966975.883312:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783966975.883330:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587936000:0@lo:400:kworker.0 00000100:00080000:0.0:1783966975.883331:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783966975.883372:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587938048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966975.883386:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587936384:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.883396:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587936896:0@lo:400:kworker.0 00000100:00100000:2.0:1783966975.883407:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587937408:0@lo:400:kworker.0 00000100:00100000:1.0:1783966975.883493:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587936128:0@lo:400:kworker.0 00000100:00100000:3.0:1783966975.883640:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587937920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 985us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966975.883647:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783966975.885011:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587937920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783966976.058134:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966976.375700:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587938176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783966976.375848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966976.376015:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938176 00000100:00100000:2.0:1783966976.376026:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938176 00000100:00100000:2.0:1783966976.376412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783966976.376425:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587938176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966976.376512:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783966976.378236:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587938176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1803us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966976.378252:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783966976.378423:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587938176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1783966977.079524:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966977.417606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966977.417838:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563773952 00000100:00100000:0.0:1783966977.417852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563773952 00000100:00100000:0.0:1783966977.417970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:0.0:1783966977.417984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+18:13174:x1870624563773952:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1783966977.418419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:13174:x1870624563773952:12345-192.168.204.59@tcp:35:umount.0 Request processed in 437us (828us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1783966977.418429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00080000:2.0:1783966977.418892:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783966977.422260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966977.423028:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563774208 00000100:00100000:0.0:1783966977.423048:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563774208 00000100:00100000:0.0:1783966977.423149:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:0.0:1783966977.423164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+19:13174:x1870624563774208:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1783966977.423659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:13174:x1870624563774208:12345-192.168.204.59@tcp:35:umount.0 Request processed in 496us (1419us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1783966977.423668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:3.0:1783966977.427981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783966977.428424:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563774464 00000100:00100000:1.0:1783966977.428440:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563774464 00000100:00100000:1.0:1783966977.428572:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:1.0:1783966977.428587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf0b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+20:13174:x1870624563774464:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:1.0:1783966977.429051:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf0b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:13174:x1870624563774464:12345-192.168.204.59@tcp:35:umount.0 Request processed in 467us (1089us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783966977.429061:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:3.0:1783966977.431665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966977.432190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563774720 00000100:00100000:0.0:1783966977.432205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563774720 00000100:00100000:0.0:1783966977.432287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:0.0:1783966977.432299:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:13174:x1870624563774720:12345-192.168.204.59@tcp:35:umount.0 00000100:00100000:0.0:1783966977.432733:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:13174:x1870624563774720:12345-192.168.204.59@tcp:35:umount.0 Request processed in 434us (1080us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1783966977.432743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:3.0:1783966977.438960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966977.439007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966977.439037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966977.439290:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966977.439542:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563774848 00000100:00100000:2.0:1783966977.439556:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563774848 00000100:00100000:1.0:1783966977.439568:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563774976 00000100:00100000:1.0:1783966977.439574:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563774976 00000100:00100000:2.0:1783966977.439951:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563775104 00000100:00100000:2.0:1783966977.439956:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563775104 00000100:00100000:1.0:1783966977.440314:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783966977.440329:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+15:2401:x1870624563774848:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966977.440353:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966977.440382:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63000/0x9269c8b316066e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b1a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.440406:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966977.440487:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+14:2401:x1870624563774848:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 164us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966977.440496:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783966977.440521:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783966977.440529:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+13:2401:x1870624563774976:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966977.440538:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966977.440547:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62c00/0x9269c8b316066dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6adb expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.440557:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966977.440601:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+12:2401:x1870624563774976:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 73us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966977.440609:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783966977.440625:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1783966977.440651:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:2403:x1870624563775104:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783966977.440661:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783966977.440673:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0c00/0x9269c8b3160670a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bf3 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.440685:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783966977.440705:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2403:x1870624563775104:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 73us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966977.440711:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1783966977.440953:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563775232 00000100:00100000:1.0:1783966977.440960:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563775232 00000100:00100000:1.0:1783966977.441191:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 80 00000100:00100000:1.0:1783966977.441203:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563775232:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:1.0:1783966977.441242:0:8714:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160671aa 00000100:00080000:1.0:1783966977.441255:0:8714:0:(import.c:65:import_set_state_nolock()) ffff9a05f571e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783966977.441320:0:8714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1783966977.441513:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4272c10e-7366-407e-b067-e3d2ea5c5b05+2:2399:x1870624563775232:12345-192.168.204.59@tcp:9:umount.0 Request processed in 314us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966977.441521:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 80 00010000:00010000:1.0:1783966977.441568:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783966977.441578:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783966977.450120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966977.450415:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563775616 00000100:00100000:3.0:1783966977.450431:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563775616 00000100:00100000:3.0:1783966977.450557:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 81 00000100:00100000:3.0:1783966977.450572:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+7:2399:x1870624563775616:12345-192.168.204.59@tcp:9:umount.0 00000020:00000080:3.0:1783966977.450621:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067419 00000020:00010000:3.0:1783966977.450647:0:8432:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a04c36bc000: total 0 00000100:00080000:3.0:1783966977.450653:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a04c36bb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783966977.450721:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1783966977.450997:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563775616:12345-192.168.204.59@tcp:9:umount.0 Request processed in 428us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966977.451006:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 81 00000020:00010000:3.0:1783966977.451037:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a04c36bc000: total 0 00010000:00010000:3.0:1783966977.451065:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a04c36bc000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783966977.451160:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90c67e6/0x9269c8b3160677d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ddd expref: 4 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966977.451236:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316067ea7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc0 expref: 3 pid: 14225 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966977.451253:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a04c36bc000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783966977.451269:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966977.451273:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966977.451275:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783966977.454740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783966977.459912:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966977.460150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563776640 00000100:00100000:0.0:1783966977.460164:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563776640 00000100:00100000:0.0:1783966977.460250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 258 00000100:00100000:0.0:1783966977.460262:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+22:2399:x1870624563776640:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783966977.460308:0:6518:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066ddd 00000020:00010000:0.0:1783966977.460328:0:6518:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a04c32fe800: total 0 00000100:00080000:0.0:1783966977.460340:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966977.460381:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1783966977.460609:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a04c32fe800: total 0 00000100:00100000:0.0:1783966977.460652:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4272c10e-7366-407e-b067-e3d2ea5c5b05+21:2399:x1870624563776640:12345-192.168.204.59@tcp:39:umount.0 Request processed in 390us (758us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1783966977.460662:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 258 00010000:00010000:1.0:1783966977.460693:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a04c32fe800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783966977.460763:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966977.460792:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966977.460805:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b3160676b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6d90 expref: 20 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460830:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c1cc7a00) 00010000:00010000:1.0:1783966977.460832:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966977.460837:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631400/0x9269c8b316067109 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c01 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460864:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966977.460866:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783966977.460871:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606785d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6e00 expref: 18 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460886:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966977.460889:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783966977.460893:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316067e92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fb9 expref: 17 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460908:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966977.460910:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783966977.460915:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316067180 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c1d expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460927:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a05ed1b4f00) 00010000:00010000:1.0:1783966977.460930:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783966977.460942:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0a00/0x9269c8b316067b4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6ed9 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.460964:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966977.460967:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966977.460984:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631e00/0x9269c8b316067e68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fab expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461000:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:1.0:1783966977.461002:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783966977.461006:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316067841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6df9 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461017:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966977.461019:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783966977.461022:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b316067799 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dc8 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461033:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a05f5465900) 00010000:00010000:1.0:1783966977.461036:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783966977.461039:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b3160677c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6dd6 expref: 11 pid: 7847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461053:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a04c3422800) 00010000:00010000:1.0:1783966977.461056:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783966977.461059:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b31606747b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6cf6 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461082:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a04c3347200) 00010000:00010000:1.0:1783966977.461098:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783966977.461104:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1400/0x9269c8b316067125 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6c08 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461124:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a05f5465e00) 00010000:00010000:1.0:1783966977.461127:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783966977.461130:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316067d88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6f73 expref: 8 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966977.461145:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a04c32fe800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783966977.461163:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966977.461165:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966977.461167:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966977.476532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966977.477519:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563776768 00000100:00100000:0.0:1783966977.477537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563776768 00000100:00100000:0.0:1783966977.477719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 259 00000100:00100000:0.0:1783966977.477734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+5:2399:x1870624563776768:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783966977.477812:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066de4 00000100:00080000:0.0:1783966977.477838:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966977.477886:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783966977.478583:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4272c10e-7366-407e-b067-e3d2ea5c5b05+3:2399:x1870624563776768:12345-192.168.204.59@tcp:39:umount.0 Request processed in 848us (2062us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783966977.478594:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 259 00010000:00010000:3.0:1783966977.479456:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783966977.482272:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783966978.106908:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966979.127387:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966979.448434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783966979.448470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587938304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783966979.448576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966979.449122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938304 00000100:00100000:1.0:1783966979.449134:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938304 00000100:00100000:1.0:1783966979.449212:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1783966979.449223:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587938304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783966979.449277:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783966979.449363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587938304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966979.449371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783966979.449743:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587938304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783966979.602895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966979.603006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966979.603327:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563776896 00000100:00100000:3.0:1783966979.603343:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563776896 00000100:00100000:3.0:1783966979.603446:0:9532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777024 00000100:00100000:3.0:1783966979.603450:0:9532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777024 00000100:00100000:3.0:1783966979.603485:0:9532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783966979.603498:0:9532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5961de9b-00b2-4d50-9cea-eabe4c7514df+11:2401:x1870624563776896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966979.603520:0:9532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966979.603554:0:9532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316066ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b2f expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966979.603585:0:9532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966979.603599:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783966979.603625:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2401:x1870624563777024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783966979.603648:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783966979.603674:0:9532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3b1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5961de9b-00b2-4d50-9cea-eabe4c7514df+10:2401:x1870624563776896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 174us (789us total) trans 0 rc 0/0 00010000:00010000:0.0:1783966979.603676:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316066ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b60 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783966979.603702:0:9532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:0.0:1783966979.603713:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966979.603872:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:2401:x1870624563777024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 256us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966979.603884:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:2.0:1783966979.608041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966979.608142:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777152 00000100:00100000:3.0:1783966979.608153:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777152 00000100:00100000:3.0:1783966979.608246:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1783966979.608256:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961de9b-00b2-4d50-9cea-eabe4c7514df+8:2400:x1870624563777152:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783966979.608273:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783966979.608299:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fe00/0x9269c8b3160670a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6bec expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966979.608320:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783966979.608404:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961de9b-00b2-4d50-9cea-eabe4c7514df+7:2400:x1870624563777152:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 150us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966979.608413:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:3.0:1783966979.620160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783966979.620316:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777408 00000100:00100000:0.0:1783966979.620325:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777408 00000100:00100000:0.0:1783966979.620408:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 260 00000100:00100000:0.0:1783966979.620421:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+6:2399:x1870624563777408:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783966979.620470:0:7847:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066ef5 00000020:00010000:0.0:1783966979.620478:0:7847:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a04c375b800: total 0 00000100:00080000:0.0:1783966979.620483:0:7847:0:(import.c:65:import_set_state_nolock()) ffff9a04c375f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966979.620513:0:7847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1783966979.621341:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2399:x1870624563777408:12345-192.168.204.59@tcp:39:umount.0 Request processed in 279us (551us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1783966979.621352:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 260 00000100:00080000:2.0:1783966979.621539:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1783966979.623164:0:6506:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a04c375b800: total 0 00010000:00010000:0.0:1783966979.623251:0:6506:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a04c375b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783966979.623293:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:0.0:1783966979.623297:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783966979.623309:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316067eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fc7 expref: 4 pid: 10203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966979.623334:0:6506:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a04c375b800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783966979.623345:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966979.623347:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966979.623349:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783966979.630290:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000001:00080000:0.0:1783966979.630311:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1783966979.630318:0:6497:0:(genops.c:906:class_export_put()) final put ffff9a04c375b800/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000001:00100000:0.0:1783966979.630374:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000001:00080000:0.0:1783966979.630379:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1783966979.630402:0:6497:0:(genops.c:906:class_export_put()) final put ffff9a04c32fe800/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:1.0:1783966979.630527:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c375b800/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 for lustre-MDT0000 00000020:00000080:1.0:1783966979.630626:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fe800/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-MDT0000 00000020:00000080:1.0:1783966979.630655:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c375f800 for lustre-MDT0000 00000020:00000080:1.0:1783966979.630661:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c32fb000 for lustre-MDT0000 00000100:00100000:1.0:1783966979.645675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783966979.646179:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777536 00000100:00100000:3.0:1783966979.646190:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777536 00000100:00100000:3.0:1783966979.646326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 261 00000100:00100000:3.0:1783966979.646341:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+5:2399:x1870624563777536:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:3.0:1783966979.646401:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066efc 00000100:00080000:3.0:1783966979.646411:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a04c375d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783966979.646448:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783966979.647246:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44+3:2399:x1870624563777536:12345-192.168.204.59@tcp:39:umount.0 Request processed in 903us (1578us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783966979.647258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 261 00010000:00010000:1.0:1783966979.648604:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783966979.650096:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783966979.692963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783966979.694249:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777792 00000100:00100000:2.0:1783966979.694264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777792 00000100:00100000:2.0:1783966979.694339:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 402 00000100:00100000:2.0:1783966979.694349:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+7:2399:x1870624563777792:12345-192.168.204.59@tcp:251:umount.0 00000020:00000080:2.0:1783966979.694692:0:6511:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066dba 00000020:00010000:2.0:1783966979.694817:0:6511:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a04c3691000: total 0 00000100:00080000:2.0:1783966979.694886:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9a04c3690000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783966979.695103:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961de9b-00b2-4d50-9cea-eabe4c7514df+3:2399:x1870624563777792:12345-192.168.204.59@tcp:251:umount.0 Request processed in 751us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966979.695113:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 402 00000020:00010000:1.0:1783966979.695325:0:9521:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a04c3691000: total 0 00010000:00010000:1.0:1783966979.695329:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966979.695387:0:9521:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a04c3691000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783966979.695422:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63a00/0x9269c8b316066e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6b21 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783966979.695437:0:9521:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a04c3691000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783966979.695446:0:9521:0:(genops.c:906:class_export_put()) final put ffff9a04c3691000/5961de9b-00b2-4d50-9cea-eabe4c7514df 00010000:00010000:1.0:1783966979.695463:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966979.695465:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966979.695467:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783966979.695599:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3691000/5961de9b-00b2-4d50-9cea-eabe4c7514df for MGS 00000020:00000080:2.0:1783966979.695644:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3690000 for MGS 00010000:00010000:1.0:1783966980.152563:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966980.983231:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587938432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783966980.983359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966980.985138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587938688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966980.987325:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587938816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966980.990510:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938432 00000100:00100000:0.0:1783966980.990531:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938432 00000100:00100000:0.0:1783966980.990670:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783966980.990851:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587938432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783966980.990900:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783966980.990995:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587938432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 315us (7636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966980.991004:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783966980.995487:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587938560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783966980.996469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966980.996557:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587939200:0@lo:400:kworker.0 00000100:00100000:2.0:1783966980.996606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966980.996627:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587939712:0@lo:400:kworker.0 00000100:00100000:2.0:1783966980.996652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966980.996673:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587940224:0@lo:400:kworker.0 00000100:00100000:2.0:1783966980.996838:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966980.996891:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938688 00000100:00100000:2.0:1783966980.996982:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938688 00000100:00080000:3.0:1783966980.997066:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966980.997072:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966980.997948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939200 00000100:00100000:3.0:1783966980.997961:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939200 00000100:00100000:3.0:1783966980.998055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783966980.998068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587939200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.998210:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587939200:12345-0@lo:400:kworker.0 Request processed in 145us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966980.998219:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1783966980.998514:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587938432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966980.998555:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587938944:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.998605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966980.998643:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938944 00000100:00100000:3.0:1783966980.998647:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938944 00000100:00100000:3.0:1783966980.998679:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1783966980.998699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587938944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.998735:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587938944:12345-0@lo:400:kworker.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966980.998742:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1783966980.998822:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587938944:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.998832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587939456:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.998857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966980.998876:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939456 00000100:00100000:3.0:1783966980.998879:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939456 00000100:00100000:3.0:1783966980.998895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783966980.998900:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587939456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587939456:12345-0@lo:400:kworker.0 Request processed in 174us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966980.999082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783966980.999108:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587939456:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999131:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587939968:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966980.999190:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939968 00000100:00100000:3.0:1783966980.999193:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939968 00000100:00100000:3.0:1783966980.999239:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783966980.999245:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587939968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999274:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587939968:12345-0@lo:400:kworker.0 Request processed in 30us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966980.999280:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1783966980.999295:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966980.999312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587939968:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587940480:0@lo:400:kworker.0 00000100:00100000:3.0:1783966980.999340:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966980.999877:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966980.999938:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587939072:0@lo:400:kworker.0 00000100:00100000:0.0:1783966980.999979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000001:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587939584:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000051:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587940096:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000105:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939712 00000100:00100000:0.0:1783966981.000111:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939712 00000100:00100000:0.0:1783966981.000147:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940224 00000100:00100000:0.0:1783966981.000150:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940224 00000100:00100000:0.0:1783966981.000179:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939072 00000100:00100000:0.0:1783966981.000184:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939072 00000100:00100000:0.0:1783966981.000194:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939584 00000100:00100000:0.0:1783966981.000197:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939584 00000100:00100000:0.0:1783966981.000208:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940096 00000100:00100000:0.0:1783966981.000210:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940096 00000100:00100000:0.0:1783966981.000226:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1783966981.000232:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587939712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000277:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587939712:12345-0@lo:400:kworker.0 Request processed in 45us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.000286:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1783966981.000301:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1783966981.000307:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587940224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000332:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624587940224:12345-0@lo:400:kworker.0 Request processed in 26us (3495us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.000338:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1783966981.000347:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783966981.000352:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587939072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000392:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587939072:12345-0@lo:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.000398:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783966981.000410:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783966981.000415:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000441:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587939584:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.000447:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783966981.000457:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783966981.000469:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587940096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000502:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587940096:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.000508:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783966981.000545:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587939072:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000555:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587939584:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000564:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587940096:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000612:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587939328:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000646:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587939840:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000929:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587940352:0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.000955:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966981.000996:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938560 00000100:00100000:0.0:1783966981.001002:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938560 00000100:00100000:0.0:1783966981.001035:0:10385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587938816 00000100:00100000:0.0:1783966981.001039:0:10385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587938816 00000100:00100000:0.0:1783966981.001058:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966981.001064:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587938560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783966981.001084:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783966981.001126:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587938560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.001133:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783966981.001145:0:10385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966981.001159:0:10385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587938816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783966981.001181:0:10385:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966981.001217:0:10385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587938816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.001222:0:10385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783966981.001238:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939328 00000100:00100000:0.0:1783966981.001241:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939328 00000100:00100000:0.0:1783966981.001263:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1783966981.001268:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587939328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966981.001295:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587939328:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966981.001301:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1783966981.001335:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587938560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783966981.001484:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587938816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783966981.001498:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587939328:0@lo:400:kworker.0 00000100:00100000:1.0:1783966981.002037:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940480 00000100:00100000:1.0:1783966981.002043:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940480 00000100:00100000:1.0:1783966981.002084:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587939840 00000100:00100000:1.0:1783966981.002087:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587939840 00000100:00100000:1.0:1783966981.002099:0:8714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940352 00000100:00100000:1.0:1783966981.002101:0:8714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940352 00000100:00100000:1.0:1783966981.002116:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783966981.002124:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966981.002181:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587940480:12345-0@lo:400:kworker.0 Request processed in 58us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966981.002189:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783966981.002222:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966981.002227:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587939840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966981.002261:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587939840:12345-0@lo:400:kworker.0 Request processed in 33us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966981.002277:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783966981.002305:0:8714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783966981.002311:0:8714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624587940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783966981.002338:0:8714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624587940352:12345-0@lo:400:kworker.0 Request processed in 28us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966981.002343:0:8714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783966981.002395:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587939840:0@lo:400:kworker.0 00000100:00100000:1.0:1783966981.002407:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587940352:0@lo:400:kworker.0 00000100:00080000:3.0:1783966981.003064:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966981.003074:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783966981.003077:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783966981.003112:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587940480:0@lo:400:kworker.0 00000100:00100000:2.0:1783966981.004661:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783966981.004679:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587938688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783966981.005515:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783966981.005647:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587938688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 974us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966981.005656:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783966981.005882:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587939200:0@lo:400:kworker.0 00010000:00080000:3.0:1783966981.005914:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fced80 x1870624587939712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966981.005927:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587939712:0@lo:400:kworker.0 00010000:00080000:3.0:1783966981.005941:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fcc700 x1870624587940224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783966996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966981.005949:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587940224:0@lo:400:kworker.0 00000100:00100000:3.0:1783966981.005991:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587938688:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783966981.195423:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966981.496256:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966981.496292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587940608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783966981.496402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966981.496484:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940608 00000100:00100000:2.0:1783966981.496495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940608 00000100:00100000:2.0:1783966981.496558:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783966981.496568:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587940608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783966981.496618:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783966981.496678:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587940608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966981.496706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783966981.496804:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587940608:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783966982.202425:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783966982.274616:0:15106:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783966982.302233:0:15106:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783966982.302565:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.302585:0:15106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.302593:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.302625:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.302649:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783966982.302656:0:15106:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783966982.302685:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783966982.302691:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783966982.302698:0:15106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783966982.302732:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783966982.302866:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783966982.302946:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966982.302956:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783966982.302960:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966982.302970:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783966982.302978:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783966982.302986:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783966982.302989:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783966982.302992:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783966982.303038:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966982.303045:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783966982.303072:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966982.303080:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316066e70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e77 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966982.303096:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966982.303098:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966982.303106:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966982.303130:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587940736:0@lo:39:umount.0 00000100:00100000:3.0:1783966982.304113:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.304886:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783966982.304988:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587940864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.305094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966982.305356:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940864 00000100:00100000:0.0:1783966982.305370:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940864 00000100:00100000:3.0:1783966982.305501:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940736 00000100:00100000:3.0:1783966982.305506:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940736 00000100:00100000:3.0:1783966982.305567:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783966982.305579:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870624587940736:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783966982.305620:0:7847:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160669df 00000100:00080000:3.0:1783966982.305632:0:7847:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783966982.305724:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870624587940736:12345-0@lo:39:umount.0 Request processed in 146us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966982.305732:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1783966982.305749:0:7847:0:(genops.c:906:class_export_put()) final put ffff9a05f4e7e800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1783966982.305815:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783966982.305828:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4e7e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1783966982.306009:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783966982.306019:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+24:3648:x1870624587940864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783966982.306035:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783966982.306062:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630800/0x9269c8b316066e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e70 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.306082:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783966982.306130:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e80b464-a486-4100-b63a-6e6116a9d437+23:3648:x1870624587940864:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966982.306139:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:3.0:1783966982.307026:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4e7b000 for lustre-MDT0000 00000100:00100000:2.0:1783966982.308032:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587940864:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783966982.308116:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783966982.308131:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587940736:0@lo:39:umount.0 00000100:00080000:0.0:1783966982.308363:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783966982.308371:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783966982.308378:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783966982.314740:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314821:0:15106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314829:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314837:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314872:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783966982.314880:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314888:0:15106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314896:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314903:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314919:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783966982.314929:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314936:0:15106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314956:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.314963:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.315005:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783966982.315013:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.315021:0:15106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.315027:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.315034:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966982.315048:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783966982.315053:0:15106:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783966982.315109:0:15106:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783966982.315115:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783966982.315121:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783966982.315128:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1783966982.315138:0:15106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a04c1f6c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783966982.315145:0:15106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a04c253c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783966982.315150:0:15106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a05ee151000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783966982.315163:0:15106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a05f4e7a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1783966982.315169:0:15106:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a05ea23b380) has exports, disconnecting them 00000020:00080000:0.0:1783966982.315175:0:15106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a04c1f6c800), last request at 1783966980 00000020:00000080:0.0:1783966982.315184:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066ce1 00000100:00080000:0.0:1783966982.315208:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05ef102000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783966982.315269:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c1f6c800): rc 0 00000020:00000080:0.0:1783966982.315272:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c1f6c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783966982.315285:0:15106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a04c253c800), last request at 1783966980 00000020:00000080:0.0:1783966982.315289:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066bbb 00000100:00080000:0.0:1783966982.315295:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a04c253a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783966982.315303:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c253c800): rc 0 00000020:00000080:0.0:1783966982.315305:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c253c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1783966982.315309:0:15106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a05ee151000), last request at 1783966735 00000020:00000080:0.0:1783966982.315312:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066ab8 00000100:00080000:0.0:1783966982.315316:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05ee154000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783966982.315322:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05ee151000): rc 0 00000020:00000080:0.0:1783966982.315324:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05ee151000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783966982.315328:0:15106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a05f4e7a800), last request at 1783966735 00000020:00000080:0.0:1783966982.315332:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a79 00000100:00080000:0.0:1783966982.315335:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05ee152000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966982.315343:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1783966982.315456:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05f4e7a800): rc 0 00000004:00000080:0.0:1783966982.315464:0:15106:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb71ec7a47ae0 00000100:00080000:0.0:1783966982.315490:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783966982.315495:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1783966982.316274:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783966982.316287:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316298:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966982.316303:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316315:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966982.316323:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966982.316330:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966982.316333:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783966982.316336:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783966982.316398:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316436:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966982.316472:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316482:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1800/0x9269c8b316066e7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e85 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316500:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783966982.316504:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316510:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966982.316514:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316521:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966982.316528:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966982.316533:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966982.316536:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783966982.316538:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783966982.316554:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316561:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966982.316583:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316602:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630400/0x9269c8b316066d74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d7b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316613:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783966982.316617:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316623:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966982.316627:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316635:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966982.316642:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966982.316647:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783966982.316650:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783966982.316653:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783966982.316667:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316674:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966982.316680:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316687:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b3160670d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670df expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316708:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966982.316712:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316719:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966982.316722:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316729:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966982.316737:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966982.316742:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966982.316745:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783966982.316747:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783966982.316766:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316811:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966982.316819:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316826:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b316066930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066937 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.316838:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966982.316840:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966982.316849:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966982.316879:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587941120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.316981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.317085:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783966982.317092:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587941248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317117:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.317170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941120 00000100:00100000:2.0:1783966982.317182:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941120 00000100:00100000:2.0:1783966982.317252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941248 00000100:00100000:2.0:1783966982.317256:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941248 00000100:00100000:2.0:1783966982.317287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966982.317298:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+24:3645:x1870624587941120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966982.317317:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966982.317340:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63800/0x9269c8b316066d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066d74 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.317359:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966982.317402:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+23:3645:x1870624587941120:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966982.317411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783966982.317435:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966982.317441:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+22:3645:x1870624587941248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966982.317449:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966982.317459:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0a00/0x9269c8b3160670df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160670d8 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.317467:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966982.317489:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e80b464-a486-4100-b63a-6e6116a9d437+21:3645:x1870624587941248:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966982.317505:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783966982.317537:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587941376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.317586:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966982.317591:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587940992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.317632:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941376 00000100:00100000:2.0:1783966982.317636:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941376 00000100:00100000:2.0:1783966982.317655:0:13736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587940992 00000100:00100000:2.0:1783966982.317657:0:13736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587940992 00000100:00100000:2.0:1783966982.317670:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783966982.317676:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8e80b464-a486-4100-b63a-6e6116a9d437+22:3647:x1870624587941376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966982.317683:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966982.317691:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602179a00/0x9269c8b316066937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066930 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.317702:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966982.317723:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8e80b464-a486-4100-b63a-6e6116a9d437+21:3647:x1870624587941376:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966982.317729:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783966982.317740:0:13736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783966982.317745:0:13736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8e80b464-a486-4100-b63a-6e6116a9d437+20:3647:x1870624587940992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966982.317753:0:13736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783966982.317761:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fc00/0x9269c8b316066e85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e7e expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966982.317798:0:13736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783966982.317825:0:13736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3b1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8e80b464-a486-4100-b63a-6e6116a9d437+19:3647:x1870624587940992:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966982.317831:0:13736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783966982.317900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587940992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317907:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587941376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317929:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587941248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966982.317937:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587941120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783966982.317984:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966982.317990:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783966982.318022:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f6c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783966982.318091:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c253c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783966982.318119:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee151000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1783966982.318168:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ef102000 for lustre-MDT0000 00000020:00000080:2.0:1783966982.318174:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c253a000 for lustre-MDT0000 00000020:00000080:2.0:1783966982.318179:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ee154000 for lustre-MDT0000 00010000:00010000:1.0:1783966982.318467:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783966982.320350:0:15106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783966982.320402:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05ee189000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783966982.320630:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941504:0@lo:39:umount.0 00000100:00100000:0.0:1783966982.320732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966982.321137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941504 00000100:00100000:2.0:1783966982.321161:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941504 00000100:00100000:2.0:1783966982.321228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783966982.321239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624587941504:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783966982.321294:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066b13 00000100:00080000:2.0:1783966982.321305:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783966982.321343:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1783966982.322240:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1870624587941504:12345-0@lo:39:umount.0 Request processed in 997us (1502us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783966982.322398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:0.0:1783966982.322708:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783966982.322798:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ee189000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783966982.322809:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941504:0@lo:39:umount.0 00000100:00080000:2.0:1783966982.323512:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783966982.323517:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1783966982.323589:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783966982.323657:0:15106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783966982.323696:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a04c253f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783966982.323727:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783966982.323730:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1783966982.323832:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783966982.323920:0:15106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783966982.323932:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a04c3696800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783966982.323992:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a05ea23b380) has no exports 00000100:00100000:0.0:1783966982.324398:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941632:0@lo:9:umount.0 00000100:00100000:0.0:1783966982.324516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966982.324569:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941760:0@lo:9:umount.0 00000100:00100000:0.0:1783966982.324593:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966982.324642:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941632 00000100:00100000:0.0:1783966982.324651:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941632 00000100:00100000:0.0:1783966982.324724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941760 00000100:00100000:0.0:1783966982.324728:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941760 00000100:00100000:0.0:1783966982.324756:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966982.324791:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624587941632:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783966982.324828:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c63 00000100:00080000:0.0:1783966982.324838:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a04c1ce3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966982.324905:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783966982.325103:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1870624587941632:12345-0@lo:9:umount.0 Request processed in 337us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966982.325111:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783966982.325131:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783966982.325139:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624587941760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783966982.325152:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066da5 00000100:00080000:0.0:1783966982.325159:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9a04c375c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966982.325188:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1783966982.325271:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1870624587941760:12345-0@lo:9:umount.0 Request processed in 133us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966982.325279:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1783966982.325323:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966982.325331:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783966982.325373:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c253f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783966982.325904:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783966982.325911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1783966982.327435:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783966982.327447:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783966982.327460:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941632:0@lo:9:umount.0 00000100:00080000:0.0:1783966982.327514:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3696800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783966982.327529:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783966982.327530:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783966982.327533:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587941760:0@lo:9:umount.0 00000020:00080000:2.0:1783966982.338516:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a05ea23b380) has no exports 00000020:00000080:2.0:1783966982.403722:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606698b 00000020:00000080:2.0:1783966982.403747:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f4cf4800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783966982.405389:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783966982.405945:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783966982.405961:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783966982.405966:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a05c34cb380) has no exports 00000020:00000080:0.0:1783966982.406361:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066984 00000020:00000080:0.0:1783966982.406373:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1a52000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783966982.406440:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cf4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783966982.407115:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a52000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783966982.407197:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966982.407208:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783966982.407212:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1a57000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783966982.407215:0:15106:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a57000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783966982.407225:0:15106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1783966982.522567:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783966982.522578:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a04c1ce4800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783966982.522627:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:2.0:1783966982.522631:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a04c36bc000/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:3.0:1783966982.522919:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1ce4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783966982.523012:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c36bc000/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-OST0000 00000020:00000080:3.0:1783966982.523040:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1ce3800 for lustre-OST0000 00000020:00000080:3.0:1783966982.523045:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c36bb800 for lustre-OST0000 00000001:00100000:2.0:1783966982.524228:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783966982.524235:0:9512:0:(genops.c:906:class_export_put()) final put ffff9a04c375a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783966982.524261:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:2.0:1783966982.524264:0:9512:0:(genops.c:906:class_export_put()) final put ffff9a05f571b800/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:3.0:1783966982.524322:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c375a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783966982.524375:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f571b800/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-OST0001 00000020:00000080:3.0:1783966982.524391:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c375c800 for lustre-OST0001 00000020:00000080:3.0:1783966982.524395:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f571e000 for lustre-OST0001 00000001:00100000:1.0:1783966982.525319:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783966982.525340:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1783966982.525348:0:7449:0:(genops.c:906:class_export_put()) final put ffff9a05ee189800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783966982.525373:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000001:00080000:1.0:1783966982.525383:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1783966982.525386:0:7449:0:(genops.c:906:class_export_put()) final put ffff9a04c375b000/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 00000001:00100000:1.0:1783966982.525393:0:7449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4272c10e-7366-407e-b067-e3d2ea5c5b05 00000001:00080000:1.0:1783966982.525398:0:7449:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1783966982.525400:0:7449:0:(genops.c:906:class_export_put()) final put ffff9a04c32fd000/4272c10e-7366-407e-b067-e3d2ea5c5b05 00000020:00000080:3.0:1783966982.525534:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee189800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783966982.525599:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c375b000/d0c45c58-bb51-41b8-9d5e-a7f9b2bd0e44 for lustre-MDT0001 00000020:00000080:3.0:1783966982.525887:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fd000/4272c10e-7366-407e-b067-e3d2ea5c5b05 for lustre-MDT0001 00000020:00000080:3.0:1783966982.525918:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f1ac5000 for lustre-MDT0001 00000020:00000080:3.0:1783966982.525922:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c375d000 for lustre-MDT0001 00000020:00000080:3.0:1783966982.525926:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c32fe000 for lustre-MDT0001 00010000:00010000:1.0:1783966983.223037:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783966983.287512:0:13806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783966984.249944:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966985.273419:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783966986.105405:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783966986.105444:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587941888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783966986.105544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106557:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966986.106573:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587942016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783966986.106616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106715:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587942400:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.106742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106761:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587942912:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.106798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106839:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783966986.106845:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587942272:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.106871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106890:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587942784:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.106909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.106947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942400 00000100:00100000:0.0:1783966986.106956:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942400 00000100:00100000:0.0:1783966986.106996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942912 00000100:00100000:0.0:1783966986.106999:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942912 00000100:00100000:0.0:1783966986.107032:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942784 00000100:00100000:0.0:1783966986.107035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942784 00000100:00100000:0.0:1783966986.107049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783966986.107059:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587942912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.107115:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587942912:12345-0@lo:400:kworker.0 Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966986.107137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783966986.107161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783966986.107167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870624587942400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966986.107169:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587941888 00000100:00100000:2.0:1783966986.107177:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587941888 00000020:00080000:0.0:1783966986.107184:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783966986.107217:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870624587942400:12345-0@lo:400:kworker.0 Request processed in 48us (473us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783966986.107219:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942016 00000100:00100000:2.0:1783966986.107224:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942016 00000100:00100000:0.0:1783966986.107226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783966986.107257:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783966986.107279:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587941888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783966986.107305:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783966986.107348:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587941888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966986.107355:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783966986.107366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783966986.107370:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783966986.107376:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870624587942784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783966986.107382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587942016:12345-0@lo:13:osp-pre-1-1.0 00000020:00080000:0.0:1783966986.107387:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00002000:00000024:2.0:1783966986.107404:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783966986.107419:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3648:x1870624587942784:12345-0@lo:400:kworker.0 Request processed in 43us (508us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966986.107427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783966986.107441:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587942016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783966986.107448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783966986.107459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942272 00000100:00100000:0.0:1783966986.107464:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942272 00000100:00100000:2.0:1783966986.107476:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587942528:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.107493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783966986.107500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1870624587942272:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783966986.107509:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783966986.107510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966986.107538:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783966986.107546:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587942144:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.107551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1870624587942272:12345-0@lo:400:kworker.0 Request processed in 48us (676us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966986.107559:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1783966986.107578:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942528 00000100:00100000:0.0:1783966986.107582:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942528 00000100:00100000:2.0:1783966986.107594:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.107599:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1783966986.107604:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870624587942528:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783966986.107610:0:7847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783966986.107625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587942656:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.107638:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1870624587942528:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966986.107646:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783966986.107655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783966986.107662:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966986.107667:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966986.107671:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966986.107682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942656 00000100:00100000:0.0:1783966986.107686:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942656 00000100:00080000:2.0:1783966986.107692:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783966986.107698:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783966986.107703:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783966986.107711:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1783966986.107719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587942656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.107753:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587942656:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966986.107760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:0.0:1783966986.107800:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783966986.107829:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587942016:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1783966986.107855:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783966986.107864:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783966986.107867:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783966986.107873:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783966986.107877:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1783966986.107884:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05d86c2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966986.107905:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e38700 x1870624587943040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783966986.107937:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587942272:0@lo:400:kworker.0 00000100:00080000:0.0:1783966986.107949:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783966986.107952:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783966986.107956:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783966986.107960:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783966986.107963:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 254 00000100:00080000:0.0:1783966986.107966:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c32ff000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966986.107978:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3bb80 x1870624587943168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783966986.107988:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587942784:0@lo:400:kworker.0 00000100:00080000:0.0:1783966986.107997:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783966986.108000:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783966986.108003:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783966986.108006:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783966986.108008:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1783966986.108017:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05f1a54800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966986.108029:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3a300 x1870624587943296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783966986.108038:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587942400:0@lo:400:kworker.0 00010000:00080000:0.0:1783966986.108050:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44ec380 x1870624587942912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966986.108059:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587942912:0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.108082:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587943040:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783966986.108106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.108122:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587943168:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783966986.108140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966986.108152:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587943296:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783966986.108168:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966986.108404:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943168 00000100:00100000:3.0:1783966986.108409:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943168 00000100:00100000:3.0:1783966986.108425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943296 00000100:00100000:3.0:1783966986.108427:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943296 00000100:00100000:3.0:1783966986.108438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783966986.108443:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587943168:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1783966986.108456:0:6517:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783966986.108495:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783966986.108499:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587943296:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1783966986.108506:0:6519:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783966986.108540:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587943296:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 38us (370us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966986.108547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783966986.108564:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943040 00000100:00100000:0.0:1783966986.108567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943040 00000100:00100000:0.0:1783966986.108582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783966986.108586:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587943040:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1783966986.108592:0:6523:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783966986.108626:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587943040:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37us (518us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966986.108632:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1783966986.108659:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966986.108664:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966986.108666:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587943040:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783966986.108674:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966986.108677:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966986.108679:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587943296:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783966986.108709:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587942144 00000100:00100000:0.0:1783966986.108713:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587942144 00000100:00100000:0.0:1783966986.108738:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1783966986.108744:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:3645:x1870624587942144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966986.108799:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c34f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e80b464-a486-4100-b63a-6e6116a9d437+19:3645:x1870624587942144:12345-0@lo:400:kworker.0 Request processed in 55us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966986.108805:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1783966986.110001:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587941888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783966986.140319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587943168:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31865us (32168us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783966986.140340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1783966986.144461:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966986.144473:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966986.144479:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587943168:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1783966986.149397:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783966986.149415:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 231 00000100:00080000:2.0:1783966986.149429:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a04c1f69000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966986.149554:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac9880 x1870624587943424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783966986.149696:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587943424:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1783966986.149814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966986.150035:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943424 00000100:00100000:1.0:1783966986.150044:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943424 00000100:00100000:1.0:1783966986.150097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783966986.150106:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587943424:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1783966986.150126:0:6519:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783966986.150357:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587942528:0@lo:400:kworker.0 00000100:00100000:2.0:1783966986.150443:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8e80b464-a486-4100-b63a-6e6116a9d437:3645:1870624587942144:0@lo:400:kworker.0 00010000:00080000:2.0:1783966986.150463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44ee680 x1870624587942656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783966986.150476:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587942656:0@lo:400:kworker.0 00000100:00100000:1.0:1783966986.152567:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587943424:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2451us (2744us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783966986.152581:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1783966986.152757:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966986.152763:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966986.152766:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587943424:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1783966986.298047:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783966987.321101:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783966987.641615:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783966987.641633:0:6497:0:(genops.c:906:class_export_put()) final put ffff9a05f4e7a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783966987.643041:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4e7a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1783966987.643121:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ee152000 for lustre-MDT0000 00010000:00010000:0.0:1783966988.344108:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783966988.470961:0:15106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c34c8900 - data ffff9a05f82f8360/ffff9a04c3587800 00000020:01000000:0.0:1783966988.471114:0:15106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05ea729d80 - data ffff9a05f814eca8/ffff9a05fbd30400 00000001:00000004:0.0:1783966988.481452:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1783966988.560198:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783966988.560208:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1783966988.560226:0:15106:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a05d8ac9500 x1870624587941504/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783966992 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966988.560251:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1783966988.563957:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783966988.563967:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1783966988.563999:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783966988.564001:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783966988.566383:0:8709:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783966988.566394:0:8709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783966988.566408:0:8709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783966988.567074:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783966988.567080:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1783966988.567141:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783966988.567144:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783966988.572742:0:9986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783966988.572754:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783966988.572801:0:9986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1783966988.575562:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066953 00000020:00000080:0.0:1783966988.575579:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783966988.576945:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783966988.578537:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066968 00000020:00000080:3.0:1783966988.578694:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783966988.578716:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783966988.578722:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.578731:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783966988.578735:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a05ea238000) has no exports 00000004:01000000:3.0:1783966988.578983:0:15106:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783966988.578993:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066d9e 00000020:00000080:3.0:1783966988.578998:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c3692000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783966988.579005:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783966988.579008:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.579018:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783966988.579021:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9a04c1fdb380) has no exports 00000020:00000080:3.0:1783966988.579029:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066d97 00000020:00000080:3.0:1783966988.579032:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c3693800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783966988.579266:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783966988.579279:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3692000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783966988.579284:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3693800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783966988.579869:0:15106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783966988.579875:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783966988.579887:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783966988.579893:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783966988.579896:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783966988.579942:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.579953:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783966988.579960:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c5c 00000020:00000080:3.0:1783966988.579966:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c1ce0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783966988.579970:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783966988.579974:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.579978:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783966988.579981:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9a05f55f3380) has no exports 00000020:00000080:3.0:1783966988.579985:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c55 00000020:00000080:3.0:1783966988.579987:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a04c2538800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783966988.580374:0:15106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783966988.580379:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783966988.580390:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1783966988.580393:0:15106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783966988.580395:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783966988.580426:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.580431:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783966988.580444:0:15106:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783966988.580450:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066b0c 00000020:00000080:3.0:1783966988.580455:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05fcff4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783966988.580459:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783966988.580463:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.580466:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783966988.580468:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a05f4f70000) has no exports 00000020:00000080:3.0:1783966988.580472:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066b05 00000020:00000080:3.0:1783966988.580475:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05ee18e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783966988.581581:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3696800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783966988.581595:0:37:0:(genops.c:906:class_export_put()) final put ffff9a04c3694800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783966988.581599:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3694800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783966988.581606:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783966988.581701:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1ce0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783966988.581708:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2538800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783966988.581713:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c253f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783966988.581717:0:37:0:(genops.c:906:class_export_put()) final put ffff9a04c253d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783966988.581729:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c253d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783966988.581733:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783966988.581764:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783966988.581782:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1783966988.608140:0:15106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1783966988.608150:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783966988.608156:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1783966988.608165:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783966988.608279:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.608295:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783966988.608329:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.608333:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783966988.608339:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1a13800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783966988.608345:0:15106:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a13800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783966988.608362:0:15106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783966988.608529:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606696f 00000020:00000080:3.0:1783966988.608545:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac1000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783966988.609135:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ee189000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783966988.609147:0:37:0:(genops.c:906:class_export_put()) final put ffff9a05ee150000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783966988.609150:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee150000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783966988.609160:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783966988.609326:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783966988.609333:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.609341:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783966988.609346:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a05ea23cd40) has no exports 00000020:00000080:3.0:1783966988.609378:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.609395:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783966988.609402:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066976 00000020:00000080:3.0:1783966988.609408:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783966988.609826:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783966988.609832:0:37:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac2800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783966988.609835:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783966988.609840:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1783966988.609979:0:15106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05ed1cf800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783966988.609985:0:15106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ed1cf800 3 00000020:01000004:3.0:1783966988.609989:0:15106:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05ed1cf800 from lustre-MDT0000 00000020:00000080:3.0:1783966988.610018:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.610023:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783966988.610025:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac6800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783966988.610028:0:15106:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783966988.610036:0:15106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783966988.610124:0:15106:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1783966988.610128:0:15106:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783966988.610132:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783966988.610135:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.610138:0:15106:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783966988.610147:0:15106:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a05c8331000 8e80b464-a486-4100-b63a-6e6116a9d437 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783966988.610154:0:15106:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a05ea2399c0) has exports, disconnecting them 00000020:00080000:3.0:1783966988.610158:0:15106:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a05c8331000), last request at 1783966715 00000020:00000080:3.0:1783966988.610181:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066914 00000020:00010000:3.0:1783966988.610187:0:15106:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a05c8331000: total 1 00000100:00080000:3.0:1783966988.610194:0:15106:0:(import.c:65:import_set_state_nolock()) ffff9a05c8333800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783966988.610219:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05c8331000): rc 0 00000020:00080000:3.0:1783966988.610224:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a05ea2399c0) has no exports 00000100:00100000:3.0:1783966988.610328:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a05c3474400:6512] 2 exiting: rc = 0 00000020:00010000:0.0:1783966988.610572:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a05c8331000: total 1 00010000:00010000:0.0:1783966988.610629:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a05c8331000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783966988.610680:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62600/0x9269c8b316066e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e2a expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610700:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62200/0x9269c8b316066e3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e38 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610713:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62000/0x9269c8b316066e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e46 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610725:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050200/0x9269c8b316066e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e54 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610736:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602178e00/0x9269c8b316066a10 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066a09 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610755:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274f200/0x9269c8b3160670b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160670ae expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610803:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602051a00/0x9269c8b316066e69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e62 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610832:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62e00/0x9269c8b316066a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066a17 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610847:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274e600/0x9269c8b3160670d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160670ca expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610858:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030200/0x9269c8b316066d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066d2e expref: 5 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610869:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0200/0x9269c8b3160670c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160670bc expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610891:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602051000/0x9269c8b316066e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e8c expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610902:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631a00/0x9269c8b316066e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316066e1c expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966988.610914:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a05c8331000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1783966988.610929:0:6507:0:(genops.c:906:class_export_put()) final put ffff9a05c8331000/8e80b464-a486-4100-b63a-6e6116a9d437 00000020:00000080:1.0:1783966988.611210:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1783966988.611268:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a05c3497c00:6510] 0 exiting: rc = 1 00000100:00100000:1.0:1783966988.611360:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a05c3496a00:6511] 1 exiting: rc = 0 00010000:00010000:0.0:1783966988.611458:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966988.611460:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966988.611462:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783966988.611491:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c8331000/8e80b464-a486-4100-b63a-6e6116a9d437 for MGS 00000100:00100000:3.0:1783966988.611704:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611714:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611722:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611729:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611735:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611740:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611746:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611763:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611784:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611799:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611806:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611811:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611817:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611823:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611830:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611838:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611845:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611851:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611856:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611861:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611868:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611874:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611892:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611898:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611904:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611908:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611914:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611920:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611925:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611932:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611938:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611944:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611951:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611957:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611962:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611968:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611973:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611979:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611984:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611990:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.611996:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612002:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612016:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612021:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612027:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612032:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612037:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612043:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612048:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612054:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612060:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612065:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612071:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612075:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612080:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612085:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612090:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612095:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612100:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612104:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612109:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612115:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612120:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966988.612125:0:15106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783966988.613155:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05c8333800 for MGS 00000020:01000000:3.0:1783966988.618134:0:15106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05f4fdc0c0 - data ffff9a05f831c000/ffff9a04c35fc800 00000020:01000000:3.0:1783966988.618285:0:15106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05e08cfea0 - data ffff9a05f801c360/ffff9a05d8cb9800 00000020:00000080:3.0:1783966988.620169:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160668f8 00000020:00000080:3.0:1783966988.620184:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05d9228000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783966988.620323:0:15106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05ed1cf800 from MGS, refs=2 00000020:01000004:3.0:1783966988.620328:0:15106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ed1cf800 2 00000020:01000004:3.0:1783966988.620331:0:15106:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05ed1cf800 from MGS 00000020:00000080:3.0:1783966988.620364:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.620372:0:15106:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783966988.620374:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05c337f800/MGS 00000020:00000080:3.0:1783966988.620378:0:15106:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c337f800/MGS for MGS 00000020:01000000:3.0:1783966988.620386:0:15106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783966988.620509:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783966988.620512:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.620517:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783966988.620524:0:15106:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a05f4cb1800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783966988.620531:0:15106:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9a05c346cd40) has exports, disconnecting them 00000020:00080000:3.0:1783966988.620536:0:15106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a05f4cb1800), last request at 1783966715 00000020:00000080:3.0:1783966988.621531:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160669c3 00000020:00080000:3.0:1783966988.621612:0:15106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05f4cb1800): rc 0 00000020:00000080:3.0:1783966988.621618:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb1800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783966988.623083:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05d9228000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783966988.624872:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb1800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783966988.627209:0:15106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783966988.627221:0:15106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783966988.627226:0:15106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783966988.627234:0:15106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783966988.630103:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966988.630121:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783966988.630129:0:15106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ed1cf800 1 00000020:00000080:3.0:1783966988.630138:0:15106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160668ea 00000020:00000080:3.0:1783966988.630148:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05c337b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783966988.632759:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4cb3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783966988.632808:0:37:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb4000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783966988.632812:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783966988.632822:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1783966988.633069:0:15106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783966988.633078:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966988.633088:0:15106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783966988.633092:0:15106:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a05c34c8000) has no exports 00000020:00000080:1.0:1783966988.634992:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c337b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783966988.820668:0:15106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966988.820684:0:15106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783966988.820690:0:15106:0:(genops.c:906:class_export_put()) final put ffff9a05c2f6b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783966988.820695:0:15106:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c2f6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783966988.820701:0:15106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783966988.821065:0:15106:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05ed1cc800 00000020:02000400:0.0:1783966988.821145:0:15106:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783966989.367185:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966990.390961:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966991.223014:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783966991.223044:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587943552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783966991.223136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783966991.223245:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943552 00000100:00100000:1.0:1783966991.223254:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943552 00000100:00100000:1.0:1783966991.223319:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783966991.223343:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587943552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783966991.223377:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783966991.223427:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587943552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783966991.223434:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783966991.223505:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587943552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783966991.223615:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783966991.224210:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783966991.224221:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587943680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783966991.224256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783966991.224286:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943680 00000100:00100000:3.0:1783966991.224291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943680 00000100:00100000:3.0:1783966991.224324:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783966991.224331:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587943680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783966991.224350:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783966991.224392:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587943680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783966991.224399:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783966991.224446:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587943680:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783966991.224482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783966991.224486:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783966991.224501:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966991.224507:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1783966991.224511:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783966991.224517:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05d86c2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966991.224539:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2de680 x1870624587943936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783966991.224553:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783966991.224556:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783966991.224558:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966991.224561:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1783966991.224564:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783966991.224568:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05f1a54800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966991.224580:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dce00 x1870624587944064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783966991.224589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783966991.224592:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783966991.224594:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966991.224597:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1783966991.224600:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783966991.224610:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a04c1f69000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966991.224621:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dc700 x1870624587944192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783966991.224638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783966991.224642:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783966991.224644:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966991.224647:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 462 00000100:00080000:3.0:1783966991.224650:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783966991.224653:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c32ff000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783966991.224663:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddf80 x1870624587944448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783966991.224693:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587944576:0@lo:400:kworker.0 00000100:00100000:3.0:1783966991.224721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.224803:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587944320:0@lo:400:kworker.0 00000100:00100000:0.0:1783966991.224845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.224873:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783966991.224878:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587943808:0@lo:400:kworker.0 00000400:00000100:0.0:1783966991.224897:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624587943808 offset 0 length 224: 4 00000100:00100000:0.0:1783966991.224923:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587943936:0@lo:38:kworker.0 00000100:00100000:0.0:1783966991.224947:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.224963:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587944064:0@lo:38:kworker.0 00000100:00100000:0.0:1783966991.224981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.224995:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587944192:0@lo:38:kworker.0 00000100:00100000:0.0:1783966991.225012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.225028:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587944448:0@lo:38:kworker.0 00000100:00100000:0.0:1783966991.225044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966991.225067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587943936 00000100:00100000:0.0:1783966991.225071:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587943936 00000100:00100000:0.0:1783966991.225093:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783966991.225097:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587943936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783966991.225114:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783966991.225145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587943936:12345-0@lo:38:kworker.0 Request processed in 46us (197us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966991.225160:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1783966991.225177:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944576 00000100:00100000:0.0:1783966991.225181:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944576 00000100:00100000:0.0:1783966991.225200:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944320 00000100:00100000:0.0:1783966991.225202:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944320 00000100:00100000:0.0:1783966991.225213:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944064 00000100:00100000:0.0:1783966991.225214:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944064 00000100:00100000:0.0:1783966991.225221:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944192 00000100:00100000:0.0:1783966991.225222:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944192 00000100:00100000:0.0:1783966991.225228:0:7847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944448 00000100:00100000:0.0:1783966991.225230:0:7847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944448 00000100:00100000:0.0:1783966991.225238:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1783966991.225243:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587944576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966991.225279:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587944576:12345-0@lo:400:kworker.0 Request processed in 36us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966991.225285:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1783966991.225296:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1783966991.225301:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783966991.225325:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587944320:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966991.225331:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1783966991.225344:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783966991.225347:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783966991.225356:0:7847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783966991.225376:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944064:12345-0@lo:38:kworker.0 Request processed in 28us (394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966991.225381:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783966991.225397:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783966991.225401:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944192:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783966991.225410:0:7847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783966991.225431:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944192:12345-0@lo:38:kworker.0 Request processed in 29us (419us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966991.225436:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783966991.225445:0:7847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783966991.225448:0:7847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944448:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783966991.225456:0:7847:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783966991.225474:0:7847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624587944448:12345-0@lo:38:kworker.0 Request processed in 24us (429us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783966991.225479:0:7847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1783966991.225496:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783966991.225500:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783966991.225515:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a05ef2ded80 x1870624587944320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966991.225525:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587944320:0@lo:400:kworker.0 00000100:00080000:0.0:1783966991.225548:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966991.225553:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966991.225556:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587943936:0@lo:38:kworker.0 00000100:00080000:0.0:1783966991.225563:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966991.225566:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966991.225568:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587944064:0@lo:38:kworker.0 00000100:00080000:0.0:1783966991.225574:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966991.225582:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966991.225584:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587944192:0@lo:38:kworker.0 00000100:00080000:0.0:1783966991.225594:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783966991.225596:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783966991.225599:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587944448:0@lo:38:kworker.0 00010000:00080000:0.0:1783966991.225626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a05ef2df800 x1870624587944576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966991.225635:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587944576:0@lo:400:kworker.0 00010000:00010000:0.0:1783966991.419896:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966992.439282:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783966992.995138:0:15307:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783966993.017352:0:15307:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1783966993.017430:0:15307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.017448:0:15307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.017463:0:15307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.017472:0:15307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.017495:0:15307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783966993.017518:0:15307:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783966993.017553:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783966993.017559:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783966993.017566:0:15307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783966993.017573:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783966993.017578:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783966993.017580:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783966993.017584:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783966993.020182:0:15307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020204:0:15307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020212:0:15307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020219:0:15307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020254:0:15307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783966993.020261:0:15307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020268:0:15307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020273:0:15307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020301:0:15307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020314:0:15307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783966993.020324:0:15307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020330:0:15307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020337:0:15307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020343:0:15307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020354:0:15307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1783966993.020359:0:15307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020364:0:15307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020369:0:15307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020374:0:15307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783966993.020391:0:15307:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1783966993.020394:0:15307:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1783966993.020427:0:15307:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1783966993.020432:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1783966993.020436:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966993.020442:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1783966993.020450:0:15307:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9a04c315e000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783966993.020456:0:15307:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9a05f4e7f000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783966993.020460:0:15307:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9a05c34c99c0) has exports, disconnecting them 00000020:00080000:3.0:1783966993.020465:0:15307:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a04c315e000), last request at 1783966991 00000020:00000080:3.0:1783966993.020474:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066cf6 00000100:00080000:3.0:1783966993.020494:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a04c3159000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783966993.020555:0:15307:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c315e000): rc 0 00000020:00000080:3.0:1783966993.020558:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a04c315e000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1783966993.020570:0:15307:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a05f4e7f000), last request at 1783966991 00000020:00000080:3.0:1783966993.020574:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066bd0 00000100:00080000:3.0:1783966993.020580:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783966993.020590:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c315e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1783966993.020654:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3159000 for lustre-MDT0001 00000020:00080000:3.0:1783966993.020669:0:15307:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05f4e7f000): rc 0 00000020:00000080:3.0:1783966993.020671:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05f4e7f000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1783966993.020680:0:15307:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb71ec1c63ae0 00000020:00000080:3.0:1783966993.020691:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4e7f000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1783966993.020738:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4e7a000 for lustre-MDT0001 00000100:00080000:3.0:1783966993.020757:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783966993.020761:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1783966993.020934:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783966993.020943:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.020953:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966993.020956:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.020965:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966993.020972:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966993.020977:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966993.020980:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783966993.020982:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783966993.021024:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021043:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966993.021076:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021083:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63400/0x9269c8b316066e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021099:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783966993.021102:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021173:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966993.021177:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021185:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966993.021192:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966993.021196:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966993.021198:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1783966993.021200:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1783966993.021217:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021223:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966993.021239:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021257:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274f000/0x9269c8b316066e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066e69 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021267:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783966993.021270:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021276:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966993.021279:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021287:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966993.021293:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966993.021299:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966993.021301:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783966993.021303:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783966993.021317:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021323:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966993.021329:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021336:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1200/0x9269c8b316066d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021361:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783966993.021365:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021371:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966993.021374:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021381:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966993.021387:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966993.021391:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783966993.021393:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783966993.021395:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783966993.021407:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021412:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966993.021418:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021424:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1800/0x9269c8b3160670ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160670d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021433:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966993.021435:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021447:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c1537200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966993.021450:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021456:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966993.021462:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966993.021466:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966993.021468:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783966993.021470:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783966993.021483:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021489:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783966993.021494:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021500:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1537200/0x9269c8b316066a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316066a1e expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966993.021513:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966993.021514:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966993.021517:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783966993.021538:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587944704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.021611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966993.021672:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587945216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.021704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966993.021730:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783966993.021736:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587945088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.021756:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966993.021815:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587944832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.021839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966993.021857:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966993.021862:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587944960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.021881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783966993.021916:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944704 00000100:00100000:2.0:1783966993.021923:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944704 00000100:00100000:2.0:1783966993.021954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587945216 00000100:00100000:2.0:1783966993.021957:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587945216 00000100:00100000:2.0:1783966993.021964:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587945088 00000100:00100000:2.0:1783966993.021966:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587945088 00000100:00100000:2.0:1783966993.021972:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944832 00000100:00100000:2.0:1783966993.021974:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944832 00000100:00100000:2.0:1783966993.021981:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587944960 00000100:00100000:2.0:1783966993.021984:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587944960 00000100:00100000:2.0:1783966993.021996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783966993.022004:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1870624587944704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783966993.022010:0:6504:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783966993 with bad export cookie 10550184273586317588 00010000:00010000:0.0:1783966993.023905:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966993.023916:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966993.023922:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783966993.034586:0:15307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783966993.034617:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a05d86c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1783966993.035832:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783966993.035839:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1783966993.035861:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783966993.035925:0:15307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783966993.035953:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783966993.035970:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783966993.035973:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1783966993.035985:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783966993.036066:0:15307:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783966993.036077:0:15307:0:(import.c:65:import_set_state_nolock()) ffff9a04c1ce3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1783966993.036103:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a05c34c99c0) has no exports 00000100:00100000:0.0:1783966993.036520:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587945344:0@lo:9:umount.0 00000100:00100000:0.0:1783966993.036606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966993.036668:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587945472:0@lo:9:umount.0 00000100:00100000:0.0:1783966993.036754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783966993.036824:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587945344 00000100:00100000:0.0:1783966993.036833:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587945344 00000100:00100000:0.0:1783966993.036891:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587945472 00000100:00100000:0.0:1783966993.036894:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587945472 00000100:00100000:0.0:1783966993.036920:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783966993.036929:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870624587945344:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783966993.036958:0:14225:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c1d 00000100:00080000:0.0:1783966993.036966:0:14225:0:(import.c:65:import_set_state_nolock()) ffff9a04c1c8c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966993.037006:0:14225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1783966993.037197:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3644:x1870624587945344:12345-0@lo:9:umount.0 Request processed in 267us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966993.037205:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783966993.037222:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783966993.037228:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1870624587945472:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783966993.037241:0:14225:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066d6d 00000100:00080000:0.0:1783966993.037247:0:14225:0:(import.c:65:import_set_state_nolock()) ffff9a04c3758800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783966993.037268:0:14225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1783966993.037346:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3644:x1870624587945472:12345-0@lo:9:umount.0 Request processed in 118us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783966993.037353:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1783966993.037371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783966993.038210:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783966993.038256:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783966993.038271:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783966993.038273:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783966993.038277:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587945344:0@lo:9:umount.0 00000100:00080000:0.0:1783966993.038290:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1ce3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1783966993.038300:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1783966993.038301:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783966993.038304:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587945472:0@lo:9:umount.0 00010000:00010000:0.0:1783966993.038330:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783966993.038854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783966993.038862:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1870624587945216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783966993.038870:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783966993 with bad export cookie 10550184273586317588 00000100:00100000:0.0:1783966993.038942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1870624587945216:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (17237us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966993.038950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783966993.038993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783966993.038999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1870624587945088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783966993.039003:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783966993 with bad export cookie 10550184273586317588 00000100:00100000:0.0:1783966993.039032:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1870624587945088:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (17275us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966993.039038:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783966993.039050:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783966993.039053:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1870624587944832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783966993.039057:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783966993 with bad export cookie 10550184273586317588 00000100:00100000:0.0:1783966993.039084:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1870624587944832:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (17244us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966993.039089:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783966993.039100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783966993.039104:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1870624587944960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783966993.039108:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783966993 with bad export cookie 10550184273586317588 00000100:00080000:3.0:1783966993.039324:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783966993.039330:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783966993.039333:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1783966993.040832:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1870624587944960:12345-0@lo:103:ldlm_bl.0 Request processed in 1718us (18941us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966993.040845:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1783966993.057132:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783966993.057188:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783966993.102481:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.159@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783966993.102489:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783966993.102500:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ef2dfb80 x1870624587943808/t0(0) o400->MGC192.168.204.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783967007 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966993.102536:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acad80 x1870624587944704/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967009 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966993.102546:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8ac9c00 x1870624587945216/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966993.102555:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8ac9180 x1870624587945088/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967009 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966993.102564:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acbb80 x1870624587944832/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967009 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783966993.102595:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acb100 x1870624587944960/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967009 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966993.103432:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3646:x1870624587944704:12345-0@lo:103:ldlm_bl.0 Request processed in 81419us (81812us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783966993.103449:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783966993.103599:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8e80b464-a486-4100-b63a-6e6116a9d437:3648:1870624587943808:0@lo:400:kworker.0 10000000:01000000:3.0:1783966993.103762:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783966993.103777:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783966993.103779:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783966993.109599:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a05ed193800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1783966993.109731:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587944832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783966993.110188:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8e80b464-a486-4100-b63a-6e6116a9d437:3647:1870624587944960:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783966993.114332:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783966993.114353:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 191 00000100:00080000:3.0:1783966993.114369:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783966993.115060:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddf80 x1870624587945600/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783966993.115157:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587945600:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1783966993.115215:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624587945600 offset 0 length 520: 4 00000100:00100000:0.0:1783966993.115280:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587944704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783966993.115294:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587945216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783966993.115339:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8e80b464-a486-4100-b63a-6e6116a9d437:3646:1870624587945088:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783966993.123108:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a05c34c99c0) has no exports 00000020:01000000:1.0:1783966993.303048:0:15307:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c34c8ba0 - data ffff9a05f82f5360/ffff9a04c32d5400 00000020:01000000:1.0:1783966993.303284:0:15307:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05ed1e1720 - data ffff9a05f80b9d80/ffff9a05f5568800 00000001:00000004:1.0:1783966993.320851:0:15307:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1783966993.422436:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783966993.423858:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1783966993.423873:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783966993.427516:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783966993.427524:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783966993.427587:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783966993.427590:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783966993.435070:0:8705:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783966993.435083:0:8705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1783966993.435098:0:8705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1783966993.436076:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783966993.436083:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1783966993.436101:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783966993.436103:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783966993.436941:0:9982:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783966993.436947:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1783966993.436960:0:9982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783966993.438093:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a3a 00000020:00000080:1.0:1783966993.438105:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee167800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783966993.439251:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee167800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1783966993.442086:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a4f 00000020:00000080:0.0:1783966993.442104:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee18a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783966993.442172:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1783966993.442178:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783966993.442188:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783966993.442192:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9a05c34ccd40) has no exports 00000004:01000000:0.0:1783966993.442378:0:15307:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783966993.442387:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066d58 00000020:00000080:0.0:1783966993.442392:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05f570b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783966993.447460:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783966993.451418:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783966993.452315:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783966993.452336:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783966993.452342:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9a05f4f74d40) has no exports 00000020:00000080:1.0:1783966993.452357:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066d51 00000020:00000080:1.0:1783966993.452369:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a04c1ce7800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783966993.457190:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f570b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1783966993.457886:0:15307:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783966993.457892:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783966993.457901:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1783966993.457909:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783966993.457912:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783966993.457930:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1ce7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783966993.457945:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1ce3000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1783966993.457957:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783966993.457971:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783966993.457976:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a04c3158000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783966993.457993:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3158000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1783966993.458000:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783966993.458103:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c16 00000020:00000080:1.0:1783966993.458110:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a04c1c8b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783966993.458127:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783966993.458131:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783966993.458137:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783966993.458141:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9a04c1fd8000) has no exports 00000020:00000080:1.0:1783966993.458147:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c0f 00000020:00000080:1.0:1783966993.458150:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a04c1f68000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783966993.458693:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1c8b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1783966993.458702:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f68000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1783966993.458898:0:15307:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783966993.458902:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783966993.458905:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1783966993.458910:0:15307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783966993.458912:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783966993.458960:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783966993.458967:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1783966993.458983:0:15307:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1783966993.458990:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a72 00000020:00000080:1.0:1783966993.458996:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee18e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783966993.459000:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1783966993.459005:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783966993.459009:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783966993.459011:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a05c34699c0) has no exports 00000020:00000080:1.0:1783966993.459016:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a6b 00000020:00000080:1.0:1783966993.459018:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05f4c8e000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783966993.459872:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f6d000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1783966993.459886:0:37:0:(genops.c:906:class_export_put()) final put ffff9a04c253b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783966993.459889:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c253b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1783966993.459895:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783966993.459981:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1783966993.459986:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4c8e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:0.0:1783966993.464986:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1783966993.521845:0:15307:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783966993.521857:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783966993.521863:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1783966993.521872:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783966993.521955:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05d86c2800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1783966993.522020:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966993.522037:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783966993.522044:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ed190000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783966993.522049:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed190000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1783966993.522061:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783966993.522261:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966993.522267:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783966993.522270:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee164800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783966993.522272:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee164800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783966993.522284:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783966993.522407:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a56 00000020:00000080:0.0:1783966993.522415:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee18c800/lustre-MDD0001_UUID 00000020:01000000:0.0:1783966993.522423:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783966993.522427:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783966993.522432:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783966993.522436:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a05ee178000) has no exports 00000020:00000080:0.0:1783966993.522466:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966993.522470:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783966993.522475:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066a5d 00000020:00000080:0.0:1783966993.522479:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee18a800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1783966993.522487:0:15307:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f1a14000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783966993.522490:0:15307:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f1a14000 2 00000020:01000004:0.0:1783966993.522493:0:15307:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05f1a14000 from lustre-MDT0001 00000020:00000080:0.0:1783966993.522521:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783966993.522526:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1783966993.522529:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee164000/lustre-MDT0001_UUID 00000020:00000080:0.0:1783966993.522532:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee164000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783966993.522540:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783966993.522570:0:15307:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783966993.522574:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783966993.522578:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783966993.522581:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783966993.522588:0:15307:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a05ee156000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783966993.522594:0:15307:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a05ee17b380) has exports, disconnecting them 00000020:00080000:0.0:1783966993.522598:0:15307:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a05ee156000), last request at 1783966735 00000020:00000080:0.0:1783966993.522603:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066ab1 00000020:00080000:0.0:1783966993.522616:0:15307:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05ee156000): rc 0 00000020:00000080:0.0:1783966993.522620:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee156000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1783966993.523454:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1783966993.523464:0:37:0:(genops.c:906:class_export_put()) final put ffff9a05ee166800/lustre-MDD0001_UUID 00000020:00000080:2.0:1783966993.523466:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee166800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1783966993.523473:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1783966993.523752:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783966993.523757:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee156000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1783966993.535926:0:15307:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1783966993.535939:0:15307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783966993.535945:0:15307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783966993.535957:0:15307:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783966993.536001:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f1a54800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1783966993.536318:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783966993.536329:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1783966993.536335:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ee18d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1783966993.536341:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1783966993.536348:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1783966993.536475:0:15307:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f1a14000 1 00000020:00000080:2.0:1783966993.536483:0:15307:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160669ed 00000020:00000080:2.0:1783966993.536494:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05f1a56800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1783966993.536505:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1783966993.536513:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a56800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1783966993.536522:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783966993.536528:0:15307:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783966993.536532:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a05f4f719c0) has no exports 00000020:00000080:3.0:1783966993.685470:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783966993.685486:0:15307:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783966993.685493:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05f1a11000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783966993.685498:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a11000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783966993.685512:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783966993.685628:0:15307:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05f1a16000 00000020:01000000:3.0:1783966993.685652:0:15307:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783966993.685656:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783966993.685660:0:15307:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783966993.685664:0:15307:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a05c346b380) has no exports 00000100:00100000:0.0:1783966993.686201:0:7847:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a05f5454c00:7847] 3 exiting: rc = 0 00000100:00100000:0.0:1783966993.686957:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a05f16b9800:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1783966993.687218:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a05c7f93c00:6519] 2 exiting: rc = 0 00000100:00100000:3.0:1783966993.692355:0:10203:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a05ef18b000:10203] 4 exiting: rc = 0 00000100:00100000:3.0:1783966993.692577:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a05f16b8000:6517] 0 exiting: rc = 1 00000100:00100000:3.0:1783966993.692673:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692684:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692690:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692697:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692705:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692711:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692716:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692723:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692730:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692736:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692741:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.692763:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693398:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693407:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693414:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693421:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693426:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693432:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693439:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693445:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693453:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693461:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693468:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693475:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693481:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693487:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693493:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693501:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693506:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693512:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693519:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693525:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693530:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693536:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693542:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693548:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693555:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693560:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693566:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693572:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693578:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693583:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693589:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693594:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693599:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693605:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693620:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693626:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693631:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693637:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693643:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693651:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693659:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693667:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693673:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693680:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693686:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693691:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693698:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693705:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693711:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693719:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693727:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.693746:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783966993.703715:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a05dbedc400:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1783966993.703983:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a05f16b8200:6520] 0 exiting: rc = 1 00000100:00100000:2.0:1783966993.704246:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704257:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704263:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704269:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704276:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704282:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704303:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704320:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704327:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704336:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704342:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704348:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704355:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704361:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704367:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704372:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704376:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704381:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704387:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704392:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704397:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704402:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704407:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704412:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704417:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704422:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704427:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704431:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704436:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704441:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704447:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704451:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704456:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704461:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704466:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704471:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704476:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704481:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704488:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704495:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704500:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704513:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704518:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704523:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704530:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704536:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704542:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704548:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704554:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704559:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704565:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704570:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704575:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704581:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704586:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704591:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704596:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704602:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704608:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704613:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704617:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704622:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704627:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.704633:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.706069:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a05d0daa800:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1783966993.706424:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a05e0930400:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1783966993.706567:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706578:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706595:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706603:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706610:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706617:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706625:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706631:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706637:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706644:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706651:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706657:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706664:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706671:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706696:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706703:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706725:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706731:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706739:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706745:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706753:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.706760:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707101:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707110:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707117:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707122:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707143:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707150:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707157:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707164:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707170:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707178:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707183:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707190:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707196:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707203:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707209:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707216:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707239:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707248:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707255:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707264:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707271:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707277:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707286:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707292:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707300:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707397:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707407:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707416:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707439:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707455:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707461:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707469:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707476:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707484:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707492:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707498:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707506:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707515:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707523:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707530:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707537:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.707544:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783966993.718706:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a05f1669800:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1783966993.719316:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a05d105f000:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1783966993.719486:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719493:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719498:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719503:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719510:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719515:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719521:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719527:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719534:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719540:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719546:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719551:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719557:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719563:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719568:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719574:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719580:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719585:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719591:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719596:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719603:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719608:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719631:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719637:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719642:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719648:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719653:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719659:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719664:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719670:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719675:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719681:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719686:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719691:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719698:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719704:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719709:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719714:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719720:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719725:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719730:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719736:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719741:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719747:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719752:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719758:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719763:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719992:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.719998:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720004:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720009:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720014:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720020:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720026:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720031:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720036:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720041:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720056:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720061:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720067:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720072:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720078:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720083:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783966993.720089:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783966993.720633:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a05cf06b600:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1783966993.720724:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a05cf06b000:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1783966993.720907:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720915:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720921:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720927:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720933:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720939:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720945:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720951:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720957:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720963:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720978:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720983:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720989:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720994:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.720999:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721005:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721011:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721017:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721022:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721028:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721034:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721040:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721046:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721052:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721057:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721063:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721068:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721073:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721079:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721084:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721090:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721095:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721101:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721107:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721114:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721119:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721124:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721130:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721136:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721143:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721148:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721154:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721160:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721166:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721171:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721185:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721190:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721196:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721202:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721207:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721212:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721217:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721222:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721227:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721232:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721238:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721243:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721248:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721254:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721260:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721266:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721272:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721277:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721283:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721630:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a05cf06b800:6529] 1 exiting: rc = 0 00000100:00100000:0.0:1783966993.721756:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a05f1669c00:6528] 0 exiting: rc = 1 00000100:00100000:2.0:1783966993.721947:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721956:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721961:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721967:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721972:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721978:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721984:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721989:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721994:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.721999:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722004:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722009:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722015:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722019:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722023:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722039:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722044:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722050:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722055:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722060:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722065:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722071:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722077:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722081:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722086:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722091:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722096:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722100:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722106:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722111:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722117:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722122:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722127:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722131:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722136:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722141:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722146:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722151:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722157:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722162:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722167:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722172:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722177:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722182:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722186:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722191:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722196:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722201:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722205:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722210:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722221:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722226:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722231:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722236:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722240:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722246:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722251:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722256:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722261:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722265:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722270:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722274:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722279:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.722284:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783966993.723209:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a05f8939600:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1783966993.723399:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a05d105fa00:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1783966993.723671:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a05d105f600:6533] 2 exiting: rc = 0 00000100:00100000:2.0:1783966993.723920:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723926:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723932:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723937:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723942:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723947:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723953:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723959:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723964:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723970:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723975:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723981:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723987:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.723993:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724013:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724020:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724026:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724031:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724036:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724041:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724059:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724064:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724070:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724076:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724081:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724087:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724092:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724098:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724103:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724109:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724115:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724121:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724126:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724132:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724138:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724144:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724150:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724157:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724177:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724185:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724191:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724197:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724203:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724208:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724213:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724220:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724226:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724232:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724237:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724243:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724248:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724253:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724259:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724265:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724271:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724285:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724291:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724297:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724304:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724311:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724317:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724322:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724328:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783966993.724334:0:15307:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783966993.729679:0:15307:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783966993.729699:0:15307:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783966993.729707:0:15307:0:(genops.c:906:class_export_put()) final put ffff9a05ed196800/MDS_uuid 00000020:00000080:1.0:1783966993.729715:0:15307:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed196800/MDS_uuid for MDS 00000020:01000000:1.0:1783966993.729739:0:15307:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783966993.729950:0:15307:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783966994.493581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783966995.510953:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783966996.348554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783966996.348566:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783966996.348570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783966996.348574:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783966996.348578:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783966996.348587:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1783966996.348594:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783966996.348604:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a04c1f69000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966996.348704:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8acb100 x1870624587945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783966996.348764:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783966996.349011:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783966996.349013:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783966996.349016:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1783966996.349019:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783966996.349024:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c32ff000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783966996.349036:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac9880 x1870624587945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783966996.349235:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587945856:0@lo:400:kworker.0 00000400:00000100:2.0:1783966996.349287:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587945856 offset 0 length 224: 4 00000100:00100000:2.0:1783966996.349341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783966996.349346:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946112:0@lo:400:kworker.0 00000400:00000100:2.0:1783966996.349363:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946112 offset 0 length 224: 4 00000100:00100000:3.0:1783966996.350756:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587945728:0@lo:38:kworker.0 00000400:00000100:3.0:1783966996.350819:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587945728 offset 0 length 520: 4 00000100:00100000:3.0:1783966996.350843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587945984:0@lo:38:kworker.0 00000400:00000100:3.0:1783966996.350857:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587945984 offset 0 length 520: 4 00010000:00010000:2.0:1783966996.534977:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783966997.561164:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783966998.163599:0:15508:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783966998.184498:0:15508:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783966998.184558:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966998.184573:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966998.184581:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966998.184589:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783966998.184612:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783966998.184617:0:15508:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783966998.184643:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783966998.184656:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acb100 x1870624587945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966998.184677:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783966998.184683:0:15508:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783966998.184689:0:15508:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783966998.184694:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783966998.184719:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acb100 x1870624587945728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966998.184727:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783966998.184731:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1783966998.184904:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783966998.184912:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966998.184921:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783966998.184925:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966998.184935:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783966998.184943:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783966998.184950:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783966998.184952:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783966998.184955:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783966998.184970:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:2.0:1783966998.184974:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966998.184993:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63e00/0x9269c8b316066e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e3f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783966998.185005:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966998.185006:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783966998.185009:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783966998.185075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587945728:0@lo:38:kworker.0 00000100:00080000:0.0:1783966998.186226:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783966998.186237:0:15508:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acbb80 x1870624587945856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783966998.186261:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783966998.186266:0:15508:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783966998.186288:0:15508:0:(import.c:65:import_set_state_nolock()) ffff9a04c253e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783966998.186477:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587945856:0@lo:400:kworker.0 00000100:00100000:3.0:1783966998.186670:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587946240:0@lo:39:umount.0 00000400:00000100:3.0:1783966998.186748:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946240 offset 0 length 224: 4 00000100:00080000:2.0:1783966998.390839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783966998.390849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783966998.390852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783966998.390856:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783966998.390965:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783966998.394502:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587946368:0@lo:400:kworker.0 00000400:00000100:1.0:1783966998.394565:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946368 offset 0 length 224: 4 00010000:00010000:3.0:1783966998.583370:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783966998.909149:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783966998.909157:0:8427:0:(genops.c:906:class_export_put()) final put ffff9a04c1c8f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783966998.909256:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1c8f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783966998.909317:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1c8c000 for lustre-OST0000 00000001:00100000:0.0:1783966998.911174:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783966998.911183:0:9512:0:(genops.c:906:class_export_put()) final put ffff9a04c375f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783966998.913754:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c375f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783966998.914072:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3758800 for lustre-OST0001 00010000:00010000:2.0:1783966999.607074:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967000.633593:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967001.401324:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967001.401337:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967001.401341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967001.401345:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967001.401478:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783967001.401502:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587946496:0@lo:400:kworker.0 00000400:00000100:0.0:1783967001.401559:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946496 offset 0 length 224: 4 00010000:00010000:2.0:1783967001.656051:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967002.679209:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967003.319067:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783966993/real 1783966993] req@ffff9a05ef2ddf80 x1870624587945600/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967003.319106:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05ef2ddf80 x1870624587945600/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967003.319130:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967003.319218:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783967003.319223:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587945600:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1783967003.327477:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967003.327488:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783967003.327493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967003.327502:0:37:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1783967003.327509:0:37:0:(import.c:589:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783967003.327518:0:37:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967003.327560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dc380 x1870624587946624/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967003.327596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967003.327613:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967003.327681:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587946624:0@lo:250:kworker.0 00000400:00000100:2.0:1783967003.327753:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624587946624 offset 0 length 520: 4 00000100:00100000:0.0:1783967003.327920:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946752:0@lo:400:kworker.0 00000400:00000100:0.0:1783967003.327948:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946752 offset 0 length 224: 4 00010000:00010000:2.0:1783967003.705369:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967004.727596:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967005.753247:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967006.775074:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967007.799063:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967008.441463:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783966998/real 1783966998] req@ffff9a04c3e38e00 x1870624587946240/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967008 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967008.441497:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c3e38e00 x1870624587946240/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967008 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967008.441529:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c253e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783967008.441552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587946240:0@lo:39:umount.0 00000100:00080000:0.0:1783967008.441753:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783967008.441758:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783967008.441763:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783967008.442668:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442686:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442713:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442719:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442755:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967008.442764:0:15508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442802:0:15508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442809:0:15508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442815:0:15508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967008.442837:0:15508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783967008.442842:0:15508:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1783967008.443024:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967008.443031:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443039:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967008.443042:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443050:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967008.443057:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967008.443063:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967008.443065:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783967008.443067:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783967008.443089:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967008.443093:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443101:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602051400/0x9269c8b316066e46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443116:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967008.443214:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443222:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967008.443225:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443233:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967008.443357:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967008.443363:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783967008.443366:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783967008.443367:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783967008.443374:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967008.443377:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443383:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b3160670bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160670c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967008.443402:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967008.443403:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967008.443405:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967008.444870:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783967008.445737:0:15508:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1783967008.445745:0:15508:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1783967008.445760:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967008.445782:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783967008.445788:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9a05ee1799c0) has no exports 00000020:00080000:0.0:1783967008.445827:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9a05ee1799c0) has no exports 00000020:01000000:0.0:1783967008.451871:0:15508:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05f4fdc300 - data ffff9a05f831c870/ffff9a04c35fd800 00000020:01000000:0.0:1783967008.451998:0:15508:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05ea729420 - data ffff9a05f82cdaf8/ffff9a04c1cfa000 00100000:10000000:0.0:1783967008.464742:0:15508:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783967008.486888:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066b8a 00000020:00000080:3.0:1783967008.486902:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a04c1c8d000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783967008.486956:0:15508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff3800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783967008.486961:0:15508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff3800 2 00000020:01000004:3.0:1783967008.486965:0:15508:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05fcff3800 from lustre-OST0000 00000020:00000080:3.0:1783967008.486999:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967008.487011:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783967008.487015:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a04c1c8b800/lustre-OST0000_UUID 00000020:00000080:3.0:1783967008.487018:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1c8b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783967008.487027:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1783967008.487082:0:15508:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783967008.487087:0:15508:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783967008.487091:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783967008.487096:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783967008.487103:0:15508:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a04c1f6a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783967008.487109:0:15508:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9a04c1fdcd40) has exports, disconnecting them 00000020:00080000:3.0:1783967008.487113:0:15508:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a04c1f6a800), last request at 1783966755 00000020:00000080:3.0:1783967008.487117:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066bb4 00000020:00080000:3.0:1783967008.487138:0:15508:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c1f6a800): rc 0 00000020:00000080:3.0:1783967008.487144:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a04c1f6a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783967008.494325:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1c8d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783967008.496604:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f6a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783967008.500841:0:15508:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783967008.500851:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967008.500856:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783967008.500864:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967008.501017:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967008.501027:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783967008.501036:0:15508:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783967008.501042:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967008.501047:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783967008.501055:0:15508:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a04c2538000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967008.501063:0:15508:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9a04c1fd99c0) has exports, disconnecting them 00000020:00080000:0.0:1783967008.501067:0:15508:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a04c2538000), last request at 1783966755 00000020:00000080:0.0:1783967008.501071:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066bc9 00000020:00080000:0.0:1783967008.501088:0:15508:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c2538000): rc 0 00000020:00000080:0.0:1783967008.501093:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a04c2538000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783967008.501891:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f69000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783967008.501900:0:36:0:(genops.c:906:class_export_put()) final put ffff9a04c1f68800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783967008.501904:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f68800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783967008.501910:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783967008.501980:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2538000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783967008.502021:0:15508:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783967008.502026:0:15508:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783967008.502029:0:15508:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783967008.502033:0:15508:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783967008.502049:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c253e800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783967008.502156:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967008.502163:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783967008.502166:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a04c253d800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783967008.502169:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c253d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783967008.502173:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783967008.502198:0:15508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff3800 1 00000020:00000080:1.0:1783967008.502204:0:15508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066b52 00000020:00000080:1.0:1783967008.502209:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a05ee166000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783967008.502216:0:15508:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783967008.502224:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee166000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783967008.502231:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783967008.502244:0:15508:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783967008.502248:0:15508:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a05f55f0000) has no exports 00000020:00000080:1.0:1783967008.546031:0:15508:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967008.546044:0:15508:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783967008.546049:0:15508:0:(genops.c:906:class_export_put()) final put ffff9a05fcff7800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783967008.546054:0:15508:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783967008.546063:0:15508:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783967008.546207:0:15508:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05fcff5000 00000020:02000400:1.0:1783967008.546392:0:15508:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1783967008.632849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967008.632860:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967008.632863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967008.632866:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967008.632942:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967008.632962:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946880:0@lo:400:kworker.0 00000400:00000100:3.0:1783967008.633021:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587946880 offset 0 length 224: 4 00010000:00010000:0.0:1783967008.823929:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967009.848938:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967010.877634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967011.894978:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783967012.473670:0:15710:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783967012.486154:0:15710:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1783967012.486246:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967012.486265:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967012.486272:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967012.486278:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967012.486343:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783967012.486350:0:15710:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783967012.486395:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967012.486406:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8ac9880 x1870624587945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.486441:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783967012.486447:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783967012.486452:0:15710:0:(import.c:65:import_set_state_nolock()) ffff9a04c32ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783967012.486456:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967012.486460:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8ac9880 x1870624587945984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967016 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.486467:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967012.486471:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:3.0:1783967012.486550:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587945984:0@lo:38:kworker.0 00010000:00010000:0.0:1783967012.486615:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967012.486622:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967012.486630:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967012.486634:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967012.486642:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967012.486660:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967012.486666:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783967012.486668:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783967012.486671:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783967012.486686:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:0.0:1783967012.486689:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967012.486695:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d63200/0x9269c8b316066e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967012.486706:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967012.486708:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967012.486710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783967012.487730:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967012.487741:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8ac8000 x1870624587946112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967012 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.487801:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05d8acbb80 x1870624587946368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.487813:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ef2dc000 x1870624587946496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967017 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.487829:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ef2dea00 x1870624587946752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.487839:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ef2dca80 x1870624587946880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967012.487846:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783967012.487851:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783967012.487875:0:15710:0:(import.c:65:import_set_state_nolock()) ffff9a04c32f9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783967012.487971:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587947008:0@lo:39:umount.0 00000400:00000100:3.0:1783967012.488024:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624587947008 offset 0 length 224: 4 00000100:00100000:1.0:1783967012.488164:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946880:0@lo:400:kworker.0 00000100:00100000:1.0:1783967012.488173:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946752:0@lo:400:kworker.0 00000100:00100000:1.0:1783967012.488182:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624587946112:0@lo:400:kworker.0 00000100:00100000:1.0:1783967012.488209:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587946368:0@lo:400:kworker.0 00000100:00100000:1.0:1783967012.488238:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587946496:0@lo:400:kworker.0 00010000:00010000:2.0:1783967012.918944:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967013.751046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967013.751056:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783967013.943504:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967014.968591:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967015.991037:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967017.015702:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967018.040149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967018.615039:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967003/real 1783967003] req@ffff9a05ef2dc380 x1870624587946624/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967018.615076:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05ef2dc380 x1870624587946624/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783967018.615096:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967018.615162:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783967018.615167:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587946624:0@lo:250:kworker.0 00000100:00080000:1.0:1783967018.622115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8e80b464-a486-4100-b63a-6e6116a9d437->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967018.622125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783967018.622130:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967018.622137:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1783967018.622143:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783967018.622151:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967018.622189:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e10700 x1870624587947136/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783967018.622328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587947136:0@lo:250:kworker.0 00000400:00000100:3.0:1783967018.622382:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624587947136 offset 0 length 520: 4 00010000:00010000:0.0:1783967019.064929:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967020.088433:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967021.114804:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967022.136254:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967022.710934:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967012/real 1783967012] req@ffff9a05d8ac8380 x1870624587947008/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967022 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967022.710966:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05d8ac8380 x1870624587947008/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967022 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967022.710986:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32f9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783967022.711009:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587947008:0@lo:39:umount.0 00000100:00080000:2.0:1783967022.711182:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967022.711188:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967022.711193:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783967022.712135:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712149:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712158:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712165:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712182:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967022.712188:0:15710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712195:0:15710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712202:0:15710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712208:0:15710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.712229:0:15710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783967022.712243:0:15710:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783967022.712283:0:15710:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783967022.712287:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783967022.712291:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967022.712296:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783967022.712300:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9a05f4f73380) has no exports 00000020:00080000:2.0:1783967022.712321:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9a05f4f73380) has no exports 00010000:00010000:3.0:1783967022.712428:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967022.712430:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967022.712438:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967022.712450:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62400 already unused, calling callback (ffffffffc150bc20) 00010000:00010000:0.0:1783967022.712453:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967022.712463:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967022.712466:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967022.712472:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967022.712477:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967022.712485:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967022.712489:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967022.712500:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967022.712501:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967022.712506:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783967022.712510:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1783967022.712514:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783967022.712518:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783967022.712520:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783967022.712526:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967022.712531:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967022.712539:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b316066e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e31 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967022.712540:0:13735:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:0.0:1783967022.712546:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967022.712555:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967022.712558:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967022.712560:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967022.712566:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160670ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160670b5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967022.712582:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967022.712585:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967022.712586:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783967022.713926:0:15710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c25802a0 - data ffff9a05f8325438/ffff9a04c3589c00 00000020:01000000:2.0:1783967022.714040:0:15710:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05ea729840 - data ffff9a05f82b36c0/ffff9a04c3645800 00100000:10000000:3.0:1783967022.731787:0:15710:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783967022.747504:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066cb0 00000020:00000080:2.0:1783967022.747517:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a04c315b000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783967022.747531:0:15710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05ef299800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783967022.747535:0:15710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ef299800 2 00000020:01000004:2.0:1783967022.747538:0:15710:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05ef299800 from lustre-OST0001 00000020:00000080:2.0:1783967022.747560:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967022.747569:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783967022.747572:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a04c315e800/lustre-OST0001_UUID 00000020:00000080:2.0:1783967022.747575:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c315e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783967022.747582:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1783967022.748252:0:15710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8e80b464-a486-4100-b63a-6e6116a9d437->MGS 00010000:00010000:2.0:1783967022.748270:0:15710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c1536000/0x9269c8b316066a09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967022.748283:0:15710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c1536000/0x9269c8b316066a09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967022.748289:0:15710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783967022.748292:0:15710:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783967022.748295:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783967022.748311:0:15710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:2.0:1783967022.748315:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c1536000/0x9269c8b316066a09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066a10 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967022.748347:0:15710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967022.748355:0:15710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967022.748360:0:15710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967022.748362:0:15710:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783967022.748364:0:15710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783967022.748373:0:15710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:2.0:1783967022.748376:0:15710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1600/0x9269c8b316066e8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316066e93 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783967022.748393:0:15710:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783967022.748397:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783967022.748399:0:15710:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783967022.748400:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783967022.748404:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783967022.748415:0:15710:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05f7e10700 x1870624587947136/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783967038 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783967022.748429:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783967022.748432:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1783967022.749976:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8e80b464-a486-4100-b63a-6e6116a9d437:3644:1870624587947136:0@lo:250:kworker.0 00000020:00000080:0.0:1783967022.750019:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c315b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1783967022.750286:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783967022.750297:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066906 00000020:00000080:2.0:1783967022.750306:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a05ed197800/8e80b464-a486-4100-b63a-6e6116a9d437 00000020:01000000:2.0:1783967022.750315:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.159@tcp (flags='') 00000020:00000080:2.0:1783967022.750325:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967022.750331:0:15710:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783967022.750335:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a05c3468000) has no exports 10000000:01000000:3.0:1783967022.750391:0:6515:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1783967022.750448:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.159@tcp: client import never connected 00000100:00080000:2.0:1783967022.750465:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1783967022.750468:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783967022.750470:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783967022.750472:0:15710:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783967022.750506:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967022.750511:0:15710:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.159@tcp (uuid 8e80b464-a486-4100-b63a-6e6116a9d437) 00000020:01000000:2.0:1783967022.750518:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783967022.750550:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967022.750555:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783967022.750559:0:15710:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a04c315f800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783967022.750564:0:15710:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9a05f55f19c0) has exports, disconnecting them 00000020:00080000:2.0:1783967022.750569:0:15710:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a04c315f800), last request at 1783966777 00000020:00000080:2.0:1783967022.750573:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066cda 00000020:00080000:2.0:1783967022.750584:0:15710:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c315f800): rc 0 00000020:00000080:2.0:1783967022.750588:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a04c315f800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783967022.750906:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed197800/8e80b464-a486-4100-b63a-6e6116a9d437 for MGC192.168.204.159@tcp 00000020:00000080:0.0:1783967022.750915:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ed193800 for MGC192.168.204.159@tcp 00000020:00000080:0.0:1783967022.750928:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05ed194000/8e80b464-a486-4100-b63a-6e6116a9d437 00000020:00000080:0.0:1783967022.750930:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed194000/8e80b464-a486-4100-b63a-6e6116a9d437 for MGC192.168.204.159@tcp 00000020:01000000:0.0:1783967022.750935:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.159@tcp (8e80b464-a486-4100-b63a-6e6116a9d437) 00000020:00000080:0.0:1783967022.751330:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c315f800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783967022.754872:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783967022.754881:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783967022.754885:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783967022.754893:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783967022.755056:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967022.755065:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1783967022.755072:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783967022.755106:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783967022.755112:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783967022.755120:0:15710:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a04c32fc000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783967022.755126:0:15710:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9a04c3478000) has exports, disconnecting them 00000020:00080000:3.0:1783967022.755131:0:15710:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a04c32fc000), last request at 1783966777 00000020:00000080:3.0:1783967022.755135:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066cef 00000020:00080000:3.0:1783967022.755151:0:15710:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c32fc000): rc 0 00000020:00000080:3.0:1783967022.755158:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a04c32fc000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1783967022.755740:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c32ff000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783967022.755748:0:36:0:(genops.c:906:class_export_put()) final put ffff9a04c32fb800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783967022.755751:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fb800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783967022.755762:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783967022.755852:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fc000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1783967022.769114:0:15710:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783967022.769123:0:15710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783967022.769128:0:15710:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783967022.769135:0:15710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967022.769167:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c32f9000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1783967022.861419:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783967022.862121:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1783967022.862825:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1783967022.863683:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1783967022.864008:0:9520:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a04c1cdec00:9520] 2 exiting: rc = 0 00000100:00100000:0.0:1783967022.864073:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a05e0905400:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1783967022.864305:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a05e0904600:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1783967022.864472:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967022.865315:0:9532:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a04c32f2400:9532] 3 exiting: rc = 0 00000100:00100000:0.0:1783967022.865455:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a05f16d2a00:6504] 1 exiting: rc = 0 00000100:00100000:2.0:1783967022.865540:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a05f16d3c00:6503] 0 exiting: rc = 1 00000100:00100000:0.0:1783967022.865547:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a05f16d3200:6505] 2 exiting: rc = 0 00000100:00100000:2.0:1783967022.865626:0:13736:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9a04c1fd2000:13736] 4 exiting: rc = 0 00000100:00100000:0.0:1783967022.866825:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866834:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866841:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866848:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866854:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866860:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866866:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866871:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866877:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866883:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866910:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866916:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866922:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866927:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866932:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866937:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866944:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866952:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866962:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866973:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866982:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.866988:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867064:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867072:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867078:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867083:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867088:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867094:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867099:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867104:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867109:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867114:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867119:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867124:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867129:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867135:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867140:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867144:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867149:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867155:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867160:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867165:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867170:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867176:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867180:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867191:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867276:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867283:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867288:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867293:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867298:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867302:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867307:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867312:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867317:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867321:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867327:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867402:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867409:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867415:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867423:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867430:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867438:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.867449:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783967022.875476:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967022.875491:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1783967022.875497:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a04c32f8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1783967022.875501:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32f8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1783967022.875509:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1783967022.875978:0:15710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05ef299800 1 00000020:00000080:0.0:1783967022.875985:0:15710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316066c7f 00000020:00000080:0.0:1783967022.875992:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a05ef299000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783967022.876242:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1783967022.876248:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967022.876254:0:15710:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783967022.876258:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9a05f55f4d40) has no exports 00000020:00000080:3.0:1783967022.883888:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ef299000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783967022.937600:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967022.938099:0:15710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783967022.938106:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a05ef29e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783967022.938121:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ef29e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783967022.938128:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783967022.939481:0:15710:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05ef29d800 00000020:01000000:0.0:1783967022.939507:0:15710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783967022.939514:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967022.939519:0:15710:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783967022.939523:0:15710:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9a05ee17cd40) has no exports 00000020:00000080:0.0:1783967022.939547:0:15710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967022.939556:0:15710:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783967022.939560:0:15710:0:(genops.c:906:class_export_put()) final put ffff9a05ee162800/OSS_uuid 00000020:00000080:0.0:1783967022.939564:0:15710:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee162800/OSS_uuid for OSS 00000020:01000000:0.0:1783967022.939569:0:15710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1783967022.939862:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a05d8b2ec00:8432] 0 exiting: rc = 1 00000100:00100000:3.0:1783967022.939948:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a05ee146200:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1783967022.939985:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a05fcf64200:8434] 2 exiting: rc = 0 00000100:00100000:1.0:1783967022.940835:0:14225:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9a05c3b73600:14225] 4 exiting: rc = 0 00000100:00080000:2.0:1783967022.941542:0:6513:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783967022.941703:0:8714:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a05f5654200:8714] 3 exiting: rc = 0 00000100:00100000:0.0:1783967022.941942:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941949:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941959:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941967:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941972:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941977:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.941983:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942004:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942010:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942015:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942020:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942026:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942031:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942035:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942041:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942046:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942052:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942057:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942062:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942067:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942073:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942079:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942097:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942102:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942108:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942114:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942119:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942134:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942140:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942146:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942150:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942155:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942159:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942164:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942169:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942174:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942179:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942185:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942191:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942196:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942201:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942206:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942211:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942215:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942220:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942225:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942245:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942253:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942259:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942264:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942269:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942274:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942279:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942283:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942288:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942293:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942298:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942310:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942315:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942321:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942326:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942331:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942336:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.942347:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967022.943184:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a05ee147600:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1783967022.943290:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a05cf233000:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1783967022.944952:0:10385:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a04c36f5200:10385] 2 exiting: rc = 0 00000100:00100000:0.0:1783967022.946365:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946385:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946392:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946397:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946403:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946408:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946414:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946419:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946425:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946430:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946436:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946441:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946447:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946452:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946457:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946463:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946468:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946474:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946479:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946485:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946491:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946496:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946501:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946507:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946513:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946519:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946524:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946529:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946545:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946550:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946556:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946562:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946567:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946572:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946578:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946584:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946589:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946595:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.946601:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947274:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947280:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947286:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947291:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947296:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947304:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947311:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947318:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947328:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947335:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947344:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947352:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947359:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947365:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947371:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947379:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947387:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947393:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947400:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947410:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947415:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947420:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947425:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947430:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.947450:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967022.949033:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a05f4e6b600:8438] 1 exiting: rc = 0 00000100:00100000:1.0:1783967022.950107:0:14673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9a05f4fb8a00:14673] 3 exiting: rc = 0 00000100:00100000:0.0:1783967022.950121:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a05f4dd0200:8437] 0 exiting: rc = 1 00000100:00100000:1.0:1783967022.950285:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a05f4e6a000:8439] 2 exiting: rc = 0 00000100:00100000:0.0:1783967022.950609:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950617:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950623:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950629:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950633:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950638:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950643:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950649:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950655:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950662:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950667:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950673:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950679:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950684:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950690:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950696:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950701:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950720:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950726:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950733:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950738:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950744:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950750:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950756:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950762:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950787:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950794:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950801:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950806:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950812:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950817:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950822:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950829:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950847:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950853:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950860:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950867:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950874:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950880:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950886:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.950968:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951095:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951102:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951112:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951118:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951124:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951433:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951439:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951444:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951450:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951455:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951460:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951465:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951477:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951483:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951489:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951499:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951505:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951511:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951527:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951535:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951544:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951558:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.951570:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967022.966484:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a05f4e6aa00:8441] 1 exiting: rc = 0 00000100:00100000:3.0:1783967022.966512:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a05f4e6b400:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1783967022.967163:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967171:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967176:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967181:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967187:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967192:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967197:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967202:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967207:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967213:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967218:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967223:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967238:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967244:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967248:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967254:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967259:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967264:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967268:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967273:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967515:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967525:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967530:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967630:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.967638:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971021:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971043:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971048:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971053:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971058:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971062:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971086:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971092:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971097:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971102:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971108:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971112:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971117:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971122:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971136:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971142:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971147:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971152:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971158:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971162:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971167:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971172:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971177:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971181:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971186:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971192:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971197:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971202:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971208:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971213:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971218:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971222:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971227:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971242:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971247:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971251:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971257:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971262:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.971267:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.972215:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a05f54aa800:8443] 1 exiting: rc = 0 00000100:00100000:2.0:1783967022.972367:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a05f4e62600:8442] 0 exiting: rc = 1 00000100:00100000:1.0:1783967022.973414:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973435:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973442:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973447:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973473:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973480:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973486:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973493:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973500:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973506:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973511:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973518:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973523:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973530:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973535:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973541:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973560:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973567:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973574:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973579:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973585:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973591:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973596:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973602:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973609:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973614:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973620:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973625:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973644:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973652:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973657:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973662:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973668:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973674:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973681:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973687:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973700:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973706:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973712:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973717:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973739:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973745:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973750:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973756:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973761:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973767:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973980:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973987:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.973993:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974000:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974006:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974013:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974033:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974040:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974046:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974052:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974058:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974064:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974069:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974075:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974082:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974089:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974097:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967022.974103:0:15710:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783967022.987511:0:15710:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783967044.290012:0:16475:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783967056.235705:0:17075:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783967056.235713:0:17075:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783967056.235715:0:17075:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783967056.236161:0:17075:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05fcff7800 00000020:01000004:1.0:1783967056.236177:0:17075:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783967056.236184:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783967056.236257:0:17075:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a04c1fd99c0) 00000020:00000080:1.0:1783967056.236345:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783967056.337860:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783967056.342980:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783967056.357897:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1783967056.363764:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.365463:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.366084:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.366310:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.366498:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.366925:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.367448:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.368029:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.368378:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.368622:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.369363:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1783967056.369902:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.370106:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.370715:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783967056.371549:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783967056.372957:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783967056.373405:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783967056.373992:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783967056.376909:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.379099:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.380922:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.382070:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.382509:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.383166:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.383565:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.383933:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.384686:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.385298:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.385599:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.386031:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.386350:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783967056.386593:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783967056.387508:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.388866:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783967056.389304:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.389547:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783967056.389946:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783967056.390386:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.394979:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783967056.396961:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.398049:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.399398:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783967056.402307:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783967056.403558:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.413327:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.415931:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.417419:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.419156:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.419757:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1783967056.420389:0:17075:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1783967056.421527:0:17075:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783967056.422275:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1783967056.422283:0:17075:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783967056.422295:0:17075:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067ec3 00000020:01000004:1.0:1783967056.422304:0:17075:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1783967056.422308:0:17075:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1783967056.422313:0:17075:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05fcff7800 from MGS 00000020:01000004:1.0:1783967056.422317:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1783967056.422328:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a04c1fdcd40) 00000020:00000080:1.0:1783967056.422339:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1783967056.422395:0:17075:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff7800 from MGS, refs=2 00080000:01000000:1.0:1783967056.422400:0:17075:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783967056.422405:0:17075:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067ed1 00000100:00100000:1.0:1783967056.422498:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1783967056.422698:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1783967056.422705:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1783967056.424450:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1783967056.424462:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783967056.425488:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783967056.425961:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783967056.425968:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1783967056.427386:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783967056.427397:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1783967056.429549:0:17075:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1783967056.429561:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783967056.431171:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967056.431176:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967056.431178:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967056.431753:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967056.431756:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967056.431758:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967056.432943:0:17075:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783967056.445043:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783967056.445367:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783967056.448202:0:17087:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783967056.448374:0:17075:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783967056.448425:0:17075:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783967056.449811:0:17075:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783967056.452327:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967056.452510:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783967056.452517:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783967056.453062:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783967056.453069:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783967056.453639:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783967056.453647:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783967056.454397:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783967056.454417:0:17075:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:0.0:1783967056.454419:0:17075:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783967056.454452:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:0.0:1783967056.454466:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (ffff9a05c3468000) 00000020:00000080:0.0:1783967056.454485:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783967056.454581:0:17075:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05ed193800@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967056.454750:0:17075:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:0.0:1783967056.454757:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 10000000:01000000:1.0:1783967056.455494:0:17093:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1783967056.455573:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 3b28c549-2862-472c-a00b-4682deda9da4) 00000020:00000080:0.0:1783967056.455591:0:17075:0:(genops.c:1406:class_connect()) connect: client 3b28c549-2862-472c-a00b-4682deda9da4, cookie 0x9269c8b316067edf 00000100:00080000:0.0:1783967056.455613:0:17075:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967056.455619:0:17075:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967056.455712:0:17075:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e38000 x1870624587947264/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967056.455916:0:17092:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1783967056.456014:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624587947264:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783967056.456083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.456473:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947264 00000100:00100000:2.0:1783967056.456481:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947264 00000100:00100000:2.0:1783967056.456514:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783967056.456522:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870624587947264:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783967056.456547:0:17089:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 3b28c549-2862-472c-a00b-4682deda9da4@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:2.0:1783967056.456574:0:17089:0:(genops.c:1406:class_connect()) connect: client 3b28c549-2862-472c-a00b-4682deda9da4, cookie 0x9269c8b316067ee6 00000100:00080000:2.0:1783967056.456716:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9a04c44fb000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783967056.456804:0:17075:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3b28c549-2862-472c-a00b-4682deda9da4->MGS 00000020:01000004:0.0:1783967056.456823:0:17075:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783967056.456829:0:17075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783967056.456844:0:17075:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a05c34699c0) 00000020:00000080:0.0:1783967056.456856:0:17075:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783967056.459981:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+5:3644:x1870624587947264:12345-0@lo:250:mount.lustre.0 Request processed in 3447us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.459997:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783967056.460128:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783967056.460139:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:1.0:1783967056.460148:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783967056.460153:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783967056.460158:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783967056.460161:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783967056.460168:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783967056.460174:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624587947264:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783967056.464091:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967056.464384:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783967056.464391:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783967056.465141:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783967056.465147:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783967056.467633:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783967056.467644:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783967056.470111:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967056.470450:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783967056.470456:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783967056.470960:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783967056.470967:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783967056.508656:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967056.509009:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783967056.509016:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783967056.510360:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783967056.510370:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783967056.511126:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967056.511349:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783967056.511354:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783967056.511906:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783967056.511914:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783967056.512470:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967056.512588:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783967056.512593:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783967056.513454:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783967056.513460:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783967056.514230:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967056.514435:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783967056.514440:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783967056.515132:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783967056.515139:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783967056.532148:0:17075:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783967056.532450:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783967056.532458:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783967056.534196:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783967056.534211:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783967056.535367:0:17075:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783967056.535377:0:17075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783967056.536534:0:17075:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783967056.536568:0:17075:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783967056.536575:0:17075:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783967056.537352:0:17075:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783967056.537394:0:17075:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783967056.537399:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783967056.537401:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.537402:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.537404:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.537406:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.537407:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.537408:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.537410:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.537412:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.537413:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967056.537416:0:17075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783967056.537418:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967056.537419:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.537421:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.537422:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.537423:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.537424:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.537425:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.537426:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.537427:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.537428:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967056.537465:0:17075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783967056.537488:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947392:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967056.537565:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.537687:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.537764:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947392 00000100:00100000:1.0:1783967056.538023:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947392 00000100:00100000:1.0:1783967056.538104:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967056.538113:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+5:17075:x1870624587947392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783967056.538162:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783967056.538165:0:17091:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783967056.538168:0:17091:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783967056.538583:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1783967056.540200:0:17091:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1783967056.543978:0:17112:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783967056.543985:0:17112:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1783967056.543988:0:17112:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783967056.543991:0:17112:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783967056.544240:0:17112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783967056.547403:0:17091:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783967056.547416:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783967056.549488:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+5:17075:x1870624587947392:12345-0@lo:253:mount.lustre.0 Request processed in 11367us (11914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.549503:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967056.549696:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783967056.549713:0:17075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783967056.549830:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783967056.549832:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.549834:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.549835:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.549837:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.549838:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.549840:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.549841:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.549843:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.549844:0:17075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783967056.549867:0:17075:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05fcff7800 from lustre-MDT0000 10000000:01000000:2.0:1783967056.549896:0:17075:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783967056.549899:0:17075:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783967056.549903:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a05c3468000 10000000:01000000:2.0:1783967056.549908:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783967056.549916:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a05c3468000 from 1 10000000:01000000:2.0:1783967056.549919:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783967056.549957:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.549968:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.549977:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967056.549997:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967056.550036:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.550067:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967056.550159:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947520 00000100:00100000:0.0:1783967056.550165:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947520 00000100:00100000:0.0:1783967056.550208:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967056.550217:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+5:17075:x1870624587947520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967056.550229:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967056.550253:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1800/0x9269c8b316067efb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067ef4 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.550298:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1800/0x9269c8b316067efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067ef4 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.550309:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1800/0x9269c8b316067efb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067ef4 expref: 6 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.550318:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1800, rc 0) 00000100:00100000:0.0:1783967056.550358:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+6:17075:x1870624587947520:12345-0@lo:101:mount.lustre.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967056.550371:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783967056.550655:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967056.550674:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.550684:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.550748:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967056.550807:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.550834:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.550983:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947648 00000100:00100000:1.0:1783967056.550988:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947648 00000100:00100000:1.0:1783967056.551013:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967056.551020:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+6:17075:x1870624587947648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967056.551107:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+6:17075:x1870624587947648:12345-0@lo:501:mount.lustre.0 Request processed in 87us (299us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783967056.551115:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967056.551174:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947648:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783967056.551213:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783967056.551229:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551248:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967056.551256:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05fcff7800 10000000:01000000:3.0:1783967056.551403:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783967056.551409:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a05fcff7800 10000000:01000000:3.0:1783967056.551412:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783967056.551415:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a05fcff7800 from 1 10000000:01000000:3.0:1783967056.551418:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783967056.551437:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551446:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551454:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.551466:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967056.551490:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.551511:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783967056.551638:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947776 00000100:00100000:2.0:1783967056.551648:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947776 00000100:00100000:2.0:1783967056.551730:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783967056.551739:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+6:17075:x1870624587947776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967056.551748:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967056.551763:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630400/0x9269c8b316067f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067f02 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.551798:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630400/0x9269c8b316067f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067f02 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.551809:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630400/0x9269c8b316067f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067f02 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.551826:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630400, rc 0) 00000100:00100000:2.0:1783967056.551859:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+7:17075:x1870624587947776:12345-0@lo:101:mount.lustre.0 Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.551865:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967056.551867:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967056.551877:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551885:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967056.551908:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783967056.551928:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551935:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967056.551941:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783967056.551944:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967056.551948:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a05fcff7800 10000000:01000000:3.0:1783967056.551951:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783967056.551954:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783967056.551956:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783967056.551969:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551975:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.551982:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.551994:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967056.552020:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.557072:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783967056.557311:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587947904 00000100:00100000:2.0:1783967056.557323:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587947904 00000100:00100000:2.0:1783967056.557375:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967056.557385:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+7:17075:x1870624587947904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967056.557401:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967056.557421:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631a00/0x9269c8b316067f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067f10 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.557451:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631a00/0x9269c8b316067f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067f10 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.557462:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631a00/0x9269c8b316067f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067f10 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.557485:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631a00, rc 0) 00000100:00100000:2.0:1783967056.557557:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+8:17075:x1870624587947904:12345-0@lo:101:mount.lustre.0 Request processed in 173us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.557564:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783967056.557819:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587947904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967056.557837:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.557857:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.557937:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967056.557972:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.558041:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.559064:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948032 00000100:00100000:1.0:1783967056.559072:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948032 00000100:00100000:0.0:1783967056.564004:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967056.564029:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+8:17075:x1870624587948032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967056.564229:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+9:17075:x1870624587948032:12345-0@lo:501:mount.lustre.0 Request processed in 213us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967056.564331:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967056.565054:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967056.565126:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967056.565174:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967056.565202:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54ac840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.565338:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948160 00000100:00100000:1.0:1783967056.565345:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948160 00000100:00100000:1.0:1783967056.565375:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967056.565383:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+9:17075:x1870624587948160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967056.568192:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+9:17075:x1870624587948160:12345-0@lo:503:mount.lustre.0 Request processed in 2799us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.568207:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967056.568347:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967056.568742:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17113:1870624587948288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.568825:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.568858:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967056.569226:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948288 00000100:00100000:0.0:1783967056.569232:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948288 00000100:00100000:0.0:1783967056.569346:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783967056.569355:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+9:17113:x1870624587948288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967056.570429:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+9:17113:x1870624587948288:12345-0@lo:502:llog_process_th.0 Request processed in 1072us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967056.570439:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783967056.574119:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17113:1870624587948288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783967056.574302:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967056.574320:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967056.574323:0:17113:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783967056.574328:0:17113:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783967056.574332:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967056.574348:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a05f4f719c0) 00000020:00000080:3.0:1783967056.574368:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783967056.574373:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783967056.574458:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783967056.574465:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f25 00000020:00000080:3.0:1783967056.574700:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783967056.574705:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967056.574708:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967056.574710:0:17113:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783967056.574712:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967056.574715:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967056.574721:0:17113:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783967056.574724:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967056.574732:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a05f4f73380) 00000020:00000080:3.0:1783967056.574741:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783967056.574745:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783967056.574746:0:17113:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783967056.574750:0:17113:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783967056.574755:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783967056.574876:0:17113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff7800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783967056.574890:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a05f4f74d40) 00000020:00000080:3.0:1783967056.574899:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783967056.574957:0:17113:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783967056.574963:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316067f3a 00000020:00000080:3.0:1783967056.575048:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783967056.575054:0:17113:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783967056.575058:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9269c8b316067f41 00080000:01000000:3.0:1783967056.575063:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783967056.575066:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f48 00010000:00010000:0.0:1783967056.654369:0:17113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1783967056.656128:0:17113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1783967056.657250:0:17113:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783967056.657756:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a05c346b380) 00000020:00000080:0.0:1783967056.657809:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783967056.657911:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783967056.657925:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f56 00000020:00000080:1.0:1783967056.663123:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783967056.676054:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9269c8b316067f5d 00000020:00000080:1.0:1783967056.678689:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783967056.678704:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967056.678714:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.679090:0:17113:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783967056.679096:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967056.679100:0:17113:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783967056.679102:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967056.679104:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967056.679106:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967056.679110:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.679112:0:17113:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967056.679115:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967056.679120:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.679121:0:17113:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783967056.679126:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783967056.679184:0:17113:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783967056.679226:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967056.679230:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.679231:0:17113:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783967056.679234:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967056.679237:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.679239:0:17113:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1783967056.679242:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783967056.679247:0:17113:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:1.0:1783967056.679286:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967056.679301:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a04c1fdb380) 00000020:00000080:1.0:1783967056.679319:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783967056.679324:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783967056.679381:0:17113:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1783967056.679387:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783967056.679393:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f6b 00010000:00080000:1.0:1783967056.679425:0:17113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c32fe800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967056.686086:0:17113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1783967056.691641:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783967056.691660:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783967056.691705:0:17113:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783967056.691732:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316067f72 00000100:00080000:0.0:1783967056.691744:0:17113:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967056.691751:0:17113:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967056.692033:0:17113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3a300 x1870624587948416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967056.692063:0:17113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1783967056.692165:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967056.692248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.692365:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948416 00000100:00100000:3.0:1783967056.692373:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948416 00000100:00100000:3.0:1783967056.692410:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967056.692417:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587948416:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1783967056.692433:0:17100:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1783967056.692694:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967056.692699:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.692702:0:17113:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783967056.692705:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783967056.692708:0:17113:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1783967056.692709:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783967056.692711:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783967056.692712:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783967056.692725:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.692727:0:17113:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783967056.692730:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783967056.692734:0:17113:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783967056.692738:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.692739:0:17113:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783967056.692742:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783967056.692745:0:17113:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:0.0:1783967056.692766:0:17113:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783967056.692793:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783967056.692805:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a05c346cd40) 00000020:00000080:0.0:1783967056.692820:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783967056.692838:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783967056.692910:0:17113:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783967056.692916:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783967056.692923:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f80 00010000:00080000:0.0:1783967056.692952:0:17113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f1ac5000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967056.693169:0:17113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783967056.697044:0:17113:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783967056.699414:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783967056.704077:0:17113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967056.706539:0:17113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783967056.711177:0:17113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1783967056.711446:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587948416:12345-0@lo:38:llog_process_th.0 Request processed in 19021us (19191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783967056.711460:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783967056.711467:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967056.711474:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967056.711479:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948416:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783967056.711593:0:17119:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783967056.711611:0:17119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783967056.712535:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783967056.712551:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783967056.712591:0:17113:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783967056.712623:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316067f87 00000100:00080000:0.0:1783967056.712634:0:17113:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967056.712642:0:17113:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a05f1ac5000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967056.712758:0:17113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3b100 x1870624587948544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967056.712818:0:17113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783967056.712896:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967056.712900:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.712902:0:17113:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783967056.712905:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783967056.712908:0:17113:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1783967056.712910:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783967056.712912:0:17113:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783967056.712914:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783967056.712916:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.712918:0:17113:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783967056.712921:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783967056.712926:0:17113:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:1.0:1783967056.712930:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948544:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1783967056.712930:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967056.712936:0:17113:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783967056.712940:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783967056.712943:0:17113:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000400:00000100:1.0:1783967056.713112:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587948544 offset 0 length 520: 4 00000020:01000000:0.0:1783967056.713114:0:17113:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783967056.713118:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783967056.713131:0:17113:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a05c34c99c0) 00000020:00000080:0.0:1783967056.713144:0:17113:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1783967056.713149:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783967056.713224:0:17113:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783967056.713231:0:17113:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1783967056.713237:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316067f95 00010000:00080000:0.0:1783967056.713266:0:17113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05ed1cb800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967056.713493:0:17113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1783967056.713563:0:17113:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783967056.713578:0:17113:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783967056.720228:0:17113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967056.722577:0:17113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783967056.722918:0:17113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783967056.724807:0:17121:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783967056.724815:0:17121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783967056.729956:0:17113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783967056.729984:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783967056.730034:0:17113:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783967056.730057:0:17113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316067f9c 00000100:00080000:1.0:1783967056.730068:0:17113:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967056.730074:0:17113:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967056.730113:0:17113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e12a00 x1870624587948672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967056.730147:0:17113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783967056.730267:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948672:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783967056.730322:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587948672 offset 0 length 520: 4 00000020:01000000:1.0:1783967056.730439:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967056.730444:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.730446:0:17113:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783967056.730449:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967056.730453:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.730454:0:17113:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783967056.730457:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783967056.730458:0:17113:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783967056.730461:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967056.730462:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.730463:0:17113:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783967056.730466:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967056.730467:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.730469:0:17113:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783967056.730483:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783967056.730514:0:17113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17113:1870624587948800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783967056.730567:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967056.730608:0:17113:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d9300000 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.731555:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948800 00000100:00100000:3.0:1783967056.731565:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948800 00000100:00100000:3.0:1783967056.731638:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783967056.731648:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+9:17113:x1870624587948800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967056.731846:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+9:17113:x1870624587948800:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.731854:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967056.732291:0:17113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17113:1870624587948800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783967056.732324:0:17113:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967056.732330:0:17113:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967056.732332:0:17113:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783967056.732343:0:17113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783967056.737194:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783967056.737244:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783967056.737273:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.737286:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967056.737295:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05fcff7800 from 1 10000000:01000000:0.0:1783967056.737298:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967056.737357:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.737380:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.737391:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967056.737419:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967056.737491:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967056.737544:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15caf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.737592:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587948928 00000100:00100000:1.0:1783967056.737611:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587948928 00000100:00100000:1.0:1783967056.737662:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967056.737672:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+9:17075:x1870624587948928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967056.737686:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967056.737704:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067fa3 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967056.737727:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967056.737738:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967056.737747:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fa00, rc 0) 00000100:00100000:1.0:1783967056.737817:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+10:17075:x1870624587948928:12345-0@lo:101:mount.lustre.0 Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.737824:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783967056.738113:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587948928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967056.738128:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.738138:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967056.739274:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949056:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783967056.739334:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967056.739376:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783967056.739641:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949056 00000100:00100000:2.0:1783967056.739648:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949056 00000100:00100000:2.0:1783967056.739696:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967056.739704:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+10:17075:x1870624587949056:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783967056.739722:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783967056.739728:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783967056.740479:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+10:17075:x1870624587949056:12345-0@lo:256:mount.lustre.0 Request processed in 774us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.740488:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783967056.740528:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949056:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783967056.741095:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783967056.741119:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.741131:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967056.741611:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff7800 from 1 10000000:01000000:2.0:1783967056.741617:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783967056.741654:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.741662:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.741673:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967056.741701:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967056.741745:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.741819:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.742023:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949184 00000100:00100000:3.0:1783967056.742029:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949184 00000100:00100000:3.0:1783967056.742086:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967056.742094:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+10:17075:x1870624587949184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967056.742107:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967056.742123:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067fb1 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.742145:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.742154:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.742162:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0400, rc 0) 00000100:00100000:3.0:1783967056.742206:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949184:12345-0@lo:101:mount.lustre.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.742213:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967056.742417:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967056.742431:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.742439:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967056.742508:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967056.742532:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.742561:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967056.743043:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949312 00000100:00100000:0.0:1783967056.743049:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949312 00000100:00100000:0.0:1783967056.743085:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783967056.743093:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967056.743231:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949312:12345-0@lo:501:mount.lustre.0 Request processed in 139us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967056.743239:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967056.743346:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967056.743375:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967056.743415:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.743491:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.746030:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949440 00000100:00100000:1.0:1783967056.746043:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949440 00000100:00100000:1.0:1783967056.746117:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967056.746128:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967056.746309:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949440:12345-0@lo:503:mount.lustre.0 Request processed in 183us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.746317:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783967056.746455:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967056.747425:0:17123:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17123:1870624587949568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.747478:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.747518:0:17123:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.747571:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949568 00000100:00100000:1.0:1783967056.747576:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949568 00000100:00100000:1.0:1783967056.747622:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783967056.747636:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+11:17123:x1870624587949568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783967056.748554:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+11:17123:x1870624587949568:12345-0@lo:502:llog_process_th.0 Request processed in 917us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.748564:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783967056.748591:0:17123:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17123:1870624587949568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783967056.748634:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967056.748649:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748652:0:17123:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783967056.748660:0:17123:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05fcff7800 00000020:00000080:2.0:1783967056.748663:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967056.748670:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967056.748673:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748674:0:17123:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783967056.748677:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967056.748679:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748680:0:17123:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783967056.748683:0:17123:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05fcff7800 00000020:00000080:2.0:1783967056.748686:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967056.748756:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967056.748759:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748761:0:17123:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783967056.748763:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967056.748766:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748767:0:17123:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967056.748790:0:17123:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05fcff7800 00000020:00000080:2.0:1783967056.748793:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967056.748814:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967056.748818:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748819:0:17123:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967056.748821:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967056.748824:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.748953:0:17123:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783967056.748963:0:17123:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05fcff7800 00000020:00000080:2.0:1783967056.748966:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783967056.749011:0:17123:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17123:1870624587949696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.749048:0:17123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.749095:0:17123:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.749150:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949696 00000100:00100000:3.0:1783967056.749156:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949696 00000100:00100000:3.0:1783967056.749212:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783967056.749220:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+11:17123:x1870624587949696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967056.749434:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+11:17123:x1870624587949696:12345-0@lo:502:llog_process_th.0 Request processed in 214us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.749441:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967056.749622:0:17123:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17123:1870624587949696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783967056.749646:0:17123:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967056.749650:0:17123:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967056.749651:0:17123:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783967056.749654:0:17123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783967056.749993:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783967056.750012:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967056.750063:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.750075:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967056.750143:0:17075:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783967056.750146:0:17075:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05fcff7800 10000000:01000000:3.0:1783967056.750149:0:17075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05fcff7800 10000000:01000000:3.0:1783967056.750154:0:17075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967056.750159:0:17075:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05fcff7800 from 1 10000000:01000000:3.0:1783967056.750162:0:17075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783967056.750206:0:17075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.750216:0:17075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.750226:0:17075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.750243:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967056.750278:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.750312:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967056.750412:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949824 00000100:00100000:2.0:1783967056.750418:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949824 00000100:00100000:2.0:1783967056.750456:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967056.750464:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+11:17075:x1870624587949824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967056.750474:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967056.750486:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631600/0x9269c8b316067fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067fbf expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.750507:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631600/0x9269c8b316067fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067fbf expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.750517:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631600/0x9269c8b316067fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fbf expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.750526:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783967056.750559:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587949824:12345-0@lo:101:mount.lustre.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.750566:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783967056.750714:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967056.750728:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967056.750737:0:17075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967056.750860:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967056.750894:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.750918:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.750934:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587949952 00000100:00100000:3.0:1783967056.750938:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587949952 00000100:00100000:3.0:1783967056.750965:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967056.750972:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587949952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967056.751096:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587949952:12345-0@lo:501:mount.lustre.0 Request processed in 124us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.751103:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967056.751137:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587949952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967056.751172:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587950080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967056.751345:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967056.751374:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657240 going to sleep for 11 seconds 00000100:00100000:1.0:1783967056.751425:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950080 00000100:00100000:1.0:1783967056.751430:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950080 00000100:00100000:1.0:1783967056.751456:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783967056.751461:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587950080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967056.751534:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587950080:12345-0@lo:503:mount.lustre.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967056.751541:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967056.751561:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587950080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967056.751737:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.751791:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.751812:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950208 00000100:00100000:2.0:1783967056.751816:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950208 00000100:00100000:2.0:1783967056.751947:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967056.751961:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.752037:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950208:12345-0@lo:502:llog_process_th.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.752043:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967056.752077:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967056.752089:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950208:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783967056.752140:0:17125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783967056.752156:0:17125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a04c347b380) 00000020:00000080:2.0:1783967056.752175:0:17125:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1783967056.752402:0:17125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05fcff7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783967056.752406:0:17125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783967056.752409:0:17125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff7800 4 00010000:00080000:2.0:1783967056.752436:0:17125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1f6c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1783967056.754695:0:17125:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1783967056.754931:0:17125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783967056.754976:0:17125:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783967056.754989:0:17125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9269c8b316067fd4 00000100:00080000:2.0:1783967056.754998:0:17125:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783967056.755003:0:17125:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a04c1f6c800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967056.755036:0:17125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8acaa00 x1870624587950336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783967056.755120:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587950336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783967056.755183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783967056.755302:0:17125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783967056.755455:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950336 00000100:00100000:3.0:1783967056.755461:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950336 00000100:00100000:3.0:1783967056.755532:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967056.755538:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587950336:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783967056.755590:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587950336:12345-0@lo:38:llog_process_th.0 Request processed in 50us (406us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783967056.755609:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967056.755676:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783967056.755683:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967056.755687:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783967056.755690:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587950336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967056.756150:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.756345:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.756411:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.756446:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950464 00000100:00100000:3.0:1783967056.756457:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950464 00000100:00100000:3.0:1783967056.756525:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783967056.756532:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967056.756664:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950464:12345-0@lo:502:llog_process_th.0 Request processed in 131us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.756672:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967056.756744:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.756824:0:17125:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967056.757057:0:17125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.757110:0:17125:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.757139:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950592 00000100:00100000:3.0:1783967056.757144:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950592 00000100:00100000:3.0:1783967056.757264:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783967056.757274:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967056.757355:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17125:x1870624587950592:12345-0@lo:502:llog_process_th.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.757362:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783967056.757427:0:17125:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3b28c549-2862-472c-a00b-4682deda9da4:17125:1870624587950592:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783967056.757451:0:17125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783967056.757506:0:17075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783967056.757528:0:17075:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783967056.757544:0:17075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.757555:0:17075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783967056.757620:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783967056.757623:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.757624:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.757626:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.757627:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.757628:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.757630:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.757631:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.757633:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.757635:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967056.757639:0:17075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783967056.757641:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967056.757643:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.757644:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.757646:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.757647:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.757648:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.757649:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.757650:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.757651:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.757656:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967056.757669:0:17075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783967056.757678:0:17075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587950720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967056.757710:0:17075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967056.757724:0:17075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4ff36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967056.757918:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950720 00000100:00100000:3.0:1783967056.757923:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950720 00000100:00100000:3.0:1783967056.757987:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967056.757994:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587950720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783967056.758012:0:17089:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783967056.758024:0:17089:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783967056.761714:0:17089:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783967056.761735:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783967056.762010:0:17111:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783967056.762016:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783967056.762040:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.762061:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.762070:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.762116:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.762135:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967056.762150:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587950848:0@lo:104: 00000100:00100000:3.0:1783967056.762164:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17075:x1870624587950720:12345-0@lo:253:mount.lustre.0 Request processed in 4167us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967056.762176:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783967056.762182:0:17075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17075:1870624587950720:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783967056.762199:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967056.762251:0:17111:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a6e40 going to sleep for 11 seconds 10000000:01000000:2.0:1783967056.762270:0:17075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783967056.762274:0:17075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783967056.762276:0:17075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783967056.762277:0:17075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967056.762278:0:17075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967056.762280:0:17075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967056.762281:0:17075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967056.762282:0:17075:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967056.762284:0:17075:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783967056.762286:0:17075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967056.762288:0:17075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783967056.762302:0:17075:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783967056.766368:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950848 00000100:00100000:2.0:1783967056.766377:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950848 00000100:00100000:2.0:1783967056.766418:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783967056.766429:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587950848:12345-0@lo:104: 00010000:00010000:2.0:1783967056.766449:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.766556:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783967056.766563:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587950848:12345-0@lo:104: Request processed in 136us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967056.766572:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967056.766617:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587950848:0@lo:104: 00010000:00010000:2.0:1783967056.766786:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967056.766793:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.766812:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967056.766816:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.766824:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967056.766831:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967056.766836:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783967056.766876:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.766884:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783967056.767129:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.767274:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.767283:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0a00/0x9269c8b316067fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067faa expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967056.767296:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967056.767298:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967056.767300:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967056.767340:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587950976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967056.767388:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967056.767629:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587950976 00000100:00100000:0.0:1783967056.767635:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587950976 00010000:00010000:0.0:1783967056.767660:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967056.767694:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967056.767704:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+12:3645:x1870624587950976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967056.767716:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967056.767723:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767733:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767747:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fa00/0x9269c8b316067faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316067fa3 expref: 12 pid: 17090 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767893:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767902:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783967056.767917:0:17081:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005902537s 00010000:00010000:0.0:1783967056.767922:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767928:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767941:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.767948:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768008:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967056.768015:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768022:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768036:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768046:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967056.768132:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+11:3645:x1870624587950976:12345-0@lo:103:ldlm_bl.0 Request processed in 430us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967056.768140:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783967056.768170:0:17111:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768178:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967056.768184:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0200/0x9269c8b316067fdb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967056.768231:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587950976:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783967056.780532:0:17075:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1783967056.782912:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783967056.782980:0:17135:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1783967056.782984:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1783967056.784073:0:17136:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783967056.784309:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1783967056.784399:0:17136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1783967056.785041:0:17137:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a05ef2dce00 x1870624587951104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967056.785063:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000040:01000000:0.0:1783967056.785763:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783967056.785841:0:17075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967056.786542:0:17136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783967056.786614:0:17136:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:0.0:1783967056.788024:0:17075:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783967056.788100:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783967056.788179:0:17075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967056.789213:0:17075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783967056.789786:0:17075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783967056.789821:0:17075:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1783967056.792540:0:17075:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1783967056.795454:0:17075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783967056.799089:0:17075:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783967056.799131:0:17075:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71ec160f988 00100000:10000000:1.0:1783967056.799140:0:17075:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783967056.799680:0:17075:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783967056.799702:0:17075:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783967056.799730:0:17075:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783967056.799746:0:17075:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1783967056.804546:0:17075:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783967056.804856:0:17075:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783967057.464377:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967057.783400:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783967057.846909:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 10000000:01000000:2.0:1783967058.230910:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783967058.230919:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05fcff7800 from 7 10000000:01000000:2.0:1783967058.230925:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783967058.230976:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967058.230987:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967058.230998:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967058.231025:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587951232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783967058.231093:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967058.231176:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1240 going to sleep for 11 seconds 00000100:00100000:1.0:1783967058.231527:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951232 00000100:00100000:1.0:1783967058.231535:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951232 00000100:00100000:1.0:1783967058.231603:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967058.231613:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+11:17093:x1870624587951232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967058.231627:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967058.231642:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316067fe2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967058.231665:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967058.231675:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967058.231683:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fe00, rc 0) 00000100:00100000:1.0:1783967058.231732:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+12:17093:x1870624587951232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967058.231739:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783967058.231899:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587951232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967058.231916:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967058.231925:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967058.231986:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587951360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783967058.232018:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967058.232050:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1240 going to sleep for 11 seconds 00000100:00100000:0.0:1783967058.232107:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951360 00000100:00100000:0.0:1783967058.232112:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951360 00000100:00100000:0.0:1783967058.232153:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967058.232161:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17093:x1870624587951360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783967058.232176:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783967058.232192:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783967058.232195:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783967058.232294:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17093:x1870624587951360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967058.232301:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783967058.232433:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587951360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783967058.232472:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783967058.232483:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967058.232491:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967058.486945:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967058.808416:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967058.889628:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967059.534882:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967059.894931:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967060.541402:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967060.919746:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:2.0:1783967061.559192:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783967061.878938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783967061.878946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783967061.878949:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967061.878957:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:2.0:1783967061.878964:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967061.878971:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967061.878997:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac8e00 x1870624587951616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967061.879015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967061.879018:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967061.879021:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967061.879024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967061.879027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783967061.879030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783967061.879032:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967061.879054:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a04c1f6c800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967061.879067:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac8700 x1870624587951744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967061.879093:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783967061.879111:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587951488:0@lo:400:kworker.0 00000100:00100000:2.0:1783967061.879182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967061.879245:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587951616:0@lo:38:kworker.0 00000100:00100000:2.0:1783967061.879277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967061.879297:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587951744:0@lo:38:kworker.0 00000100:00100000:2.0:1783967061.879321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967061.879369:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951616 00000100:00100000:2.0:1783967061.879375:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951616 00000100:00100000:2.0:1783967061.879417:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967061.879424:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587951616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783967061.879441:0:17101:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967061.880317:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951488 00000100:00100000:0.0:1783967061.880325:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951488 00000100:00100000:0.0:1783967061.880372:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967061.880380:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:3645:x1870624587951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967061.880447:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:3645:x1870624587951488:12345-0@lo:400:kworker.0 Request processed in 68us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967061.880455:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967061.880539:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587951488:0@lo:400:kworker.0 00000100:00100000:1.0:1783967061.888858:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951744 00000100:00100000:1.0:1783967061.888872:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951744 00000100:00100000:1.0:1783967061.888913:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967061.888923:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587951744:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783967061.888952:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:1.0:1783967061.888986:0:17097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9269c8b316067ff0 00000004:00100000:1.0:1783967061.889025:0:17097:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783967061.889148:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a04c44fb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967061.889260:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870624587951744:12345-0@lo:38:kworker.0 Request processed in 326us (9925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967061.889268:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783967061.889402:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05d8ac8700 x1870624587951744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967061.889420:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783967061.889435:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783967061.889440:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783967061.889443:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783967061.889449:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624587951744:0@lo:38:kworker.0 00000100:00100000:2.0:1783967061.907869:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587951616:12345-0@lo:38:kworker.0 Request processed in 28433us (28580us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967061.907896:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783967061.909048:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967061.909057:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967061.909062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587951616:0@lo:38:kworker.0 00000100:00100000:3.0:1783967061.946992:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000001:02000400:0.0:1783967062.431980:0:17380:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783967062.592126:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967062.967333:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000020:00000004:0.0:1783967063.576344:0:17432:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967063.576580:0:17432:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783967063.607885:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967063.993379:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:1.0:1783967064.632660:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783967064.654543:0:17482:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967064.654763:0:17482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783967065.014842:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:1.0:1783967065.655887:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967066.041954:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:0.0:1783967066.680666:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967066.998993:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967056/real 1783967056] req@ffff9a05f7e12a00 x1870624587948672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967066.999028:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05f7e12a00 x1870624587948672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967066.999030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783967066.999040:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783967066.999045:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1783967066.999050:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967056/real 1783967056] req@ffff9a04c3e3b100 x1870624587948544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967066 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967066.999052:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:2.0:1783967066.999059:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783967066.999068:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967066.999082:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c3e3b100 x1870624587948544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967066 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967066.999091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac8380 x1870624587952000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967066.999103:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967066.999117:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967066.999122:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1783967066.999122:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967066.999127:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1783967066.999129:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948672:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783967066.999131:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783967066.999136:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1783967066.999210:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587951872:0@lo:400:kworker.0 00000100:00100000:0.0:1783967066.999277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967066.999376:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951872 00000100:00100000:0.0:1783967066.999384:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951872 00000100:00100000:0.0:1783967066.999435:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967066.999444:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+12:3647:x1870624587951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967066.999495:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+12:3647:x1870624587951872:12345-0@lo:400:kworker.0 Request processed in 52us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967066.999503:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967066.999551:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587951872:0@lo:400:kworker.0 00000100:00080000:3.0:1783967067.009984:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967067.010009:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783967067.010015:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587948544:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1783967067.012454:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952000:0@lo:38:kworker.0 00000100:00100000:3.0:1783967067.012540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783967067.012581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:2.0:1783967067.012588:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967067.012597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967067.012636:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8acbb80 x1870624587952128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967067.012699:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967067.012704:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783967067.012706:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967067.012711:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 532 00000100:00080000:2.0:1783967067.012714:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967067.012718:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a05f1ac5000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967067.012731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8ac9880 x1870624587952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967067.012765:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587952256:0@lo:400:kworker.0 00000100:00100000:3.0:1783967067.012906:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952128:0@lo:8:kworker.0 00000100:00100000:0.0:1783967067.012976:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952000 00000100:00100000:0.0:1783967067.012985:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952000 00000100:00100000:0.0:1783967067.013034:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967067.013043:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587952000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783967067.013062:0:17100:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:3.0:1783967067.018059:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587952128 offset 0 length 520: 4 00000100:00100000:3.0:1783967067.018113:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952384:0@lo:8:kworker.0 00000400:00000100:3.0:1783967067.018143:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587952384 offset 0 length 520: 4 00000100:00100000:2.0:1783967067.018381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967067.018510:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952256 00000100:00100000:3.0:1783967067.018518:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952256 00000100:00100000:3.0:1783967067.018584:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967067.018595:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587952256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967067.018653:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587952256:12345-0@lo:400:kworker.0 Request processed in 62us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967067.018660:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783967067.018941:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05d8ac8000 x1870624587952256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967067.018957:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587952256:0@lo:400:kworker.0 00000100:00100000:3.0:1783967067.042024:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587952000:12345-0@lo:38:kworker.0 Request processed in 28973us (29475us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783967067.042039:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783967067.042980:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967067.042988:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967067.042993:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952000:0@lo:38:kworker.0 00000100:00100000:1.0:1783967067.065294:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:1.0:1783967067.704699:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967068.026550:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783967068.092145:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967068.728013:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967069.110862:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:1.0:1783967069.750897:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967070.136219:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967070.779813:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967071.163999:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:2.0:1783967071.801285:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783967072.118862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783967072.118869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783967072.118873:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967072.118881:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1783967072.118887:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783967072.118897:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967072.118929:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8acb800 x1870624587952640/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967072.118948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967072.118951:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967072.118954:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967072.118957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967072.119109:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587952768:0@lo:400:kworker.0 00000100:00100000:2.0:1783967072.119270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967072.119343:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967072.119350:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587952512:0@lo:400:kworker.0 00000100:00100000:2.0:1783967072.119460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967072.119499:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952640:0@lo:38:kworker.0 00000100:00100000:2.0:1783967072.119526:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967072.119562:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952512 00000100:00100000:2.0:1783967072.119570:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952512 00000100:00100000:2.0:1783967072.119617:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783967072.119626:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:3646:x1870624587952512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967072.119684:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:3646:x1870624587952512:12345-0@lo:400:kworker.0 Request processed in 58us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967072.119691:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783967072.119725:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952640 00000100:00100000:2.0:1783967072.119728:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952640 00000100:00100000:2.0:1783967072.119746:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967072.119751:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587952640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783967072.119767:0:17101:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783967072.122119:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952768 00000100:00100000:1.0:1783967072.122135:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952768 00000100:00100000:1.0:1783967072.122342:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967072.122353:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587952768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967072.122461:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587952768:12345-0@lo:400:kworker.0 Request processed in 110us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967072.122469:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783967072.135874:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587952512:0@lo:400:kworker.0 00010000:00080000:3.0:1783967072.135898:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05d8ac8a80 x1870624587952768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967072.135923:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587952768:0@lo:400:kworker.0 00000100:00100000:2.0:1783967072.150552:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624587952640:12345-0@lo:38:kworker.0 Request processed in 30789us (31013us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967072.150568:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783967072.150629:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967072.150648:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783967072.150652:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952640:0@lo:38:kworker.0 00000100:00100000:0.0:1783967072.183259:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967072.823073:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967073.207733:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000020:01000004:1.0:1783967073.767121:0:17828:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783967073.767125:0:17828:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1783967073.767127:0:17828:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783967073.767237:0:17828:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05c2f6c000 00000020:01000004:1.0:1783967073.767254:0:17828:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1783967073.767267:0:17828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783967073.767305:0:17828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a04c1fd8000) 00000020:00000080:1.0:1783967073.768026:0:17828:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1783967073.848901:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1783967073.915359:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.915956:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783967073.916707:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1783967073.916998:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1783967073.918022:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783967073.918262:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1783967073.919186:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1783967073.919617:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1783967073.930754:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1783967073.932336:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783967073.932851:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783967073.933180:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1783967073.933477:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783967073.934026:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1783967073.963379:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1783967073.963708:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1783967073.964149:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1783967073.964600:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.973442:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.974131:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.976147:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.976614:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.977675:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.978216:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.978809:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.979094:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.979604:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.979924:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.980626:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.982109:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.984119:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.986620:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.989050:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783967073.992468:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.993047:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.994353:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783967073.994695:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.006405:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1783967074.007955:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.008384:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1783967074.008791:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.011286:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.012019:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1783967074.012325:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.012650:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783967074.013181:0:17828:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:2.0:1783967074.020377:0:17828:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1783967074.022097:0:17828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1783967074.022116:0:17828:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783967074.022139:0:17828:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316067ffe 00000020:01000004:2.0:1783967074.022149:0:17828:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1783967074.022178:0:17828:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783967074.022196:0:17828:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783967074.022205:0:17828:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1783967074.022246:0:17828:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1783967074.022251:0:17828:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783967074.040449:0:17828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783967074.040505:0:17828:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783967074.040509:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783967074.040510:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783967074.040511:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967074.040512:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967074.040513:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967074.040514:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967074.040515:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967074.040516:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967074.040516:0:17828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967074.040520:0:17828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783967074.040521:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967074.040523:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783967074.040523:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967074.040524:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967074.040525:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967074.040526:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967074.040527:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783967074.040528:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967074.040529:0:17828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967074.040573:0:17828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783967074.040603:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587952896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967074.040680:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.040804:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47300 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.041251:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587952896 00000100:00100000:0.0:1783967074.041261:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587952896 00000100:00100000:0.0:1783967074.041366:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783967074.041377:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17828:x1870624587952896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783967074.041412:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783967074.041415:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1783967074.041422:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783967074.041853:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+12:17828:x1870624587952896:12345-0@lo:253:mount.lustre.0 Request processed in 477us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.041863:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783967074.041976:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587952896:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783967074.041990:0:17828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783967074.041993:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783967074.041994:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783967074.041995:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783967074.041996:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783967074.041997:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783967074.041999:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783967074.042000:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783967074.042002:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783967074.042003:0:17828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783967074.042027:0:17828:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05c2f6c000 from lustre-MDT0001 10000000:01000000:1.0:1783967074.042059:0:17828:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783967074.042062:0:17828:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783967074.042069:0:17828:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 00010000:00010000:1.0:1783967074.042079:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967074.042190:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967074.042224:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.042509:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.042644:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953024 00000100:00100000:2.0:1783967074.042650:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953024 00000100:00100000:2.0:1783967074.042677:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783967074.042685:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17828:x1870624587953024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967074.042766:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17828:x1870624587953024:12345-0@lo:501:mount.lustre.0 Request processed in 82us (541us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783967074.042798:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783967074.042873:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953024:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783967074.042888:0:17828:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783967074.042907:0:17828:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783967074.042913:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.042922:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.042973:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05c2f6c000 10000000:01000000:1.0:1783967074.042978:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783967074.042983:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a05c3468000 10000000:01000000:1.0:1783967074.042985:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783967074.042989:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a05c3468000 from 1 10000000:01000000:1.0:1783967074.042991:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783967074.043018:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043026:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043037:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967074.043052:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967074.043079:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.043108:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.043210:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953152 00000100:00100000:2.0:1783967074.043215:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953152 00000100:00100000:2.0:1783967074.043233:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783967074.043239:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+12:17828:x1870624587953152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967074.043247:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967074.043259:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630e00/0x9269c8b31606800c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068005 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.043291:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630e00/0x9269c8b31606800c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068005 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.043300:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630e00/0x9269c8b31606800c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068005 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.043309:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630e00, rc 0) 00000100:00100000:2.0:1783967074.043343:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+13:17828:x1870624587953152:12345-0@lo:101:mount.lustre.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.043349:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783967074.043418:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967074.043431:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043440:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.043457:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783967074.043515:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043536:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.043544:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a05c2f6c000 10000000:01000000:1.0:1783967074.043547:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783967074.043551:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a05c2f6c000 from 1 10000000:01000000:1.0:1783967074.043553:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783967074.043567:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043574:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043580:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967074.043591:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967074.043615:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.043630:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.043740:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953280 00000100:00100000:0.0:1783967074.043745:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953280 00000100:00100000:0.0:1783967074.043787:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783967074.043794:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+13:17828:x1870624587953280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967074.043802:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967074.043811:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0000/0x9269c8b31606801a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068013 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.043825:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0000/0x9269c8b31606801a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068013 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.043833:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0000/0x9269c8b31606801a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068013 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.043839:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0000, rc 0) 00000100:00100000:0.0:1783967074.043878:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+14:17828:x1870624587953280:12345-0@lo:101:mount.lustre.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.043884:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783967074.043969:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967074.043980:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.043988:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.043999:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783967074.044410:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.044426:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.044431:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783967074.044435:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783967074.044439:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a05c2f6c000 10000000:01000000:1.0:1783967074.044441:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783967074.044445:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1783967074.044447:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1783967074.044465:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.044472:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.044479:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967074.044492:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967074.046216:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.046317:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.046441:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953408 00000100:00100000:0.0:1783967074.046449:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953408 00000100:00100000:0.0:1783967074.046504:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783967074.046514:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+14:17828:x1870624587953408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967074.046640:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967074.046657:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0a00/0x9269c8b316068028 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068021 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.047289:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0a00/0x9269c8b316068028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068021 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.047304:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0a00/0x9269c8b316068028 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068021 expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.047334:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0a00, rc 0) 00000100:00100000:0.0:1783967074.047398:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953408:12345-0@lo:101:mount.lustre.0 Request processed in 886us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.047406:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967074.047441:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967074.047459:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.047468:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783967074.054704:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1783967074.057538:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967074.066004:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783967074.066086:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1783967074.066099:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1783967074.066110:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1783967074.066121:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1783967074.066135:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1783967074.066146:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1783967074.066157:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1783967074.066170:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1783967074.066180:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1783967074.066193:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1783967074.066208:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1783967074.066221:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1783967074.066233:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1783967074.066247:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1783967074.066261:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1783967074.066291:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1783967074.066306:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1783967074.066321:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1783967074.066334:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1783967074.066349:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1783967074.066363:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1783967074.066376:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1783967074.066406:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1783967074.066412:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1783967074.066668:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967074.066746:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.066835:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655840 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.066975:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953536 00000100:00100000:3.0:1783967074.066985:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953536 00000100:00100000:3.0:1783967074.067082:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783967074.067093:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967074.067300:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953536:12345-0@lo:501:mount.lustre.0 Request processed in 208us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.067308:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783967074.068998:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967074.069071:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967074.069151:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.069184:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655840 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.069375:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953664 00000100:00100000:0.0:1783967074.069383:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953664 00000100:00100000:0.0:1783967074.069454:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783967074.069465:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967074.070630:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953664:12345-0@lo:503:mount.lustre.0 Request processed in 1164us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.070641:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783967074.071573:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783967074.072333:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783967074.072437:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967074.072637:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.072821:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.076309:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953792 00000100:00100000:3.0:1783967074.076331:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953792 00000100:00100000:3.0:1783967074.076405:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783967074.076417:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967074.079736:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953792:12345-0@lo:502:mount.lustre.0 Request processed in 3310us (7088us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.079751:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967074.080146:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783967074.080420:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783967074.080454:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1783967074.080468:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1783967074.080479:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1783967074.080490:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1783967074.080581:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1783967074.080599:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1783967074.080612:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1783967074.080625:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1783967074.080639:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1783967074.080652:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1783967074.080663:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1783967074.080674:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1783967074.080688:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1783967074.080700:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1783967074.080712:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1783967074.080724:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1783967074.080735:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1783967074.080760:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1783967074.082559:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1783967074.082613:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1783967074.082628:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1783967074.082644:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1783967074.082660:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1783967074.082675:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1783967074.082689:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1783967074.082702:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1783967074.082715:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1783967074.082756:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1783967074.082797:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1783967074.082814:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1783967074.082827:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1783967074.082840:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1783967074.082854:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1783967074.082867:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1783967074.082896:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1783967074.082912:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1783967074.082924:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1783967074.082948:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1783967074.082962:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1783967074.082975:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1783967074.082989:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1783967074.083001:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1783967074.083013:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1783967074.083081:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967074.083167:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.083219:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.083379:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587953920 00000100:00100000:3.0:1783967074.083389:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587953920 00000100:00100000:3.0:1783967074.083467:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783967074.083479:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967074.083627:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587953920:12345-0@lo:502:mount.lustre.0 Request processed in 150us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.083635:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783967074.084439:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587953920:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967074.084534:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1783967074.084548:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1783967074.094433:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967074.094456:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967074.094460:0:17832:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783967074.094489:0:17832:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783967074.094493:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967074.094526:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a05f55f4d40) 00000020:00000080:1.0:1783967074.094552:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1783967074.094559:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783967074.094671:0:17832:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783967074.094679:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068036 00000020:00000080:1.0:1783967074.095431:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783967074.095437:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967074.095442:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967074.095443:0:17832:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783967074.095446:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967074.095451:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967074.095452:0:17832:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783967074.095456:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967074.095467:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a05f55f19c0) 00000020:00000080:1.0:1783967074.095481:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1783967074.095485:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783967074.095487:0:17832:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783967074.095491:0:17832:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783967074.095497:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783967074.095553:0:17832:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05c2f6c000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783967074.095566:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a05f55f0000) 00000020:00000080:1.0:1783967074.095574:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1783967074.095638:0:17832:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783967074.095644:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b31606804b 00000020:00000080:1.0:1783967074.095738:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783967074.095745:0:17832:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783967074.095750:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9269c8b316068052 00080000:01000000:1.0:1783967074.095755:0:17832:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783967074.095758:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068059 00000100:00100000:0.0:1783967074.231454:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967074.309931:0:17832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1783967074.313357:0:17832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1783967074.320062:0:17832:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783967074.336288:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1783967074.336305:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967074.336335:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.336338:0:17832:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1783967074.336343:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967074.336349:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.336350:0:17832:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1783967074.336354:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783967074.336359:0:17832:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:2.0:1783967074.336392:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783967074.336410:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a04c347cd40) 00000020:00000080:2.0:1783967074.336438:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1783967074.336443:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783967074.336557:0:17832:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1783967074.336566:0:17832:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783967074.336573:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068067 00010000:00080000:2.0:1783967074.336606:0:17832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f4cb1800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1783967074.338385:0:17832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1783967074.355583:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783967074.355600:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783967074.355656:0:17832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783967074.355683:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b31606806e 00000100:00080000:3.0:1783967074.355695:0:17832:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967074.355712:0:17832:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05f4cb1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967074.355753:0:17832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ded80 x1870624587954048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967074.355821:0:17832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783967074.356039:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783967074.356045:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783967074.356054:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967074.356059:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 548 00000100:00080000:1.0:1783967074.356062:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783967074.356066:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967074.356084:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e10380 x1870624587954176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967074.356094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967074.356097:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967074.356100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967074.356102:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967074.356147:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587954304:0@lo:400:kworker.0 00000100:00100000:1.0:1783967074.356217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1783967074.356399:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.356404:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.356406:0:17832:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783967074.356409:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783967074.356412:0:17832:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783967074.356413:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.356414:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.356416:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783967074.356418:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.356420:0:17832:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783967074.356422:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967074.356427:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.356428:0:17832:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783967074.356457:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783967074.356631:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954304 00000100:00100000:1.0:1783967074.356639:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954304 00000100:00100000:1.0:1783967074.356683:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967074.356693:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587954304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967074.356805:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587954304:12345-0@lo:400:kworker.0 Request processed in 111us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.356815:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783967074.356860:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05f7e12a00 x1870624587954304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:01000000:3.0:1783967074.357030:0:17832:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783967074.357059:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.357064:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.357065:0:17832:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783967074.357068:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783967074.357070:0:17832:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1783967074.357071:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.357073:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.357075:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783967074.357077:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.357079:0:17832:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783967074.357081:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783967074.357085:0:17832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783967074.357088:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1783967074.357563:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783967074.357615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.357651:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587954176:0@lo:38:kworker.0 00000100:00100000:0.0:1783967074.357673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.357703:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954048 00000100:00100000:2.0:1783967074.357709:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954048 00000100:00100000:0.0:1783967074.357709:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954176 00000100:00100000:0.0:1783967074.357711:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954176 00000100:00100000:0.0:1783967074.357729:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967074.357828:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587954304:0@lo:400:kworker.0 00000020:00000080:3.0:1783967074.358143:0:17832:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783967074.358174:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783967074.358178:0:17832:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:3.0:1783967074.358208:0:17832:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783967074.358211:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967074.358229:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a05f4f70000) 00000020:00000080:3.0:1783967074.358273:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783967074.358280:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783967074.360434:0:17832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1783967074.360446:0:17832:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783967074.360462:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b31606807c 00010000:00080000:2.0:1783967074.360506:0:17832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05ee18b000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.159@tcp at head 00000100:00100000:0.0:1783967074.362615:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587954176:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1783967074.362800:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587954176:12345-0@lo:38:kworker.0 Request processed in 5058us (5120us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783967074.362811:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783967074.362852:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967074.362860:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587954048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783967074.362907:0:17100:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1783967074.362951:0:17100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316068083 00000004:00100000:0.0:1783967074.362974:0:17100:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783967074.362982:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1783967074.363281:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783967074.363292:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967074.363297:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783967074.363301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587954176:0@lo:38:kworker.0 00010000:00010000:2.0:1783967074.364107:0:17832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1783967074.372215:0:17832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783967074.373037:0:17832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783967074.376050:0:17832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1783967074.377859:0:17100:0:(import.c:65:import_set_state_nolock()) ffff9a05c9dea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967074.377976:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587954048:12345-0@lo:38:llog_process_th.0 Request processed in 15112us (20357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.377990:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967074.379604:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783967074.379620:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783967074.379630:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783967074.379636:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783967074.379639:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783967074.379655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967074.380732:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967074.380752:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587954432:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1783967074.382574:0:17832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783967074.382841:0:17832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1783967074.383037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.383274:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954432 00000100:00100000:2.0:1783967074.383283:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954432 00000100:00100000:2.0:1783967074.383431:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967074.383453:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587954432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967074.383490:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783967074.383560:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587954432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.383567:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967074.383645:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587954432:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1783967074.385099:0:17837:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783967074.385106:0:17837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783967074.391129:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783967074.391146:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783967074.391219:0:17832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783967074.391243:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b31606808a 00000100:00080000:3.0:1783967074.391254:0:17832:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967074.391270:0:17832:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05ee18b000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967074.391310:0:17832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ded80 x1870624587954560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967074.391347:0:17832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783967074.391389:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967074.391393:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967074.391396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967074.391398:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1783967074.391446:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.391450:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.391452:0:17832:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783967074.391455:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783967074.391457:0:17832:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1783967074.391459:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.391460:0:17832:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967074.391462:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783967074.391464:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.391465:0:17832:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783967074.391468:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783967074.391471:0:17832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783967074.391475:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.391476:0:17832:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783967074.391478:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783967074.391482:0:17832:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:3.0:1783967074.391680:0:17832:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783967074.391685:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967074.391698:0:17832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a05ea2399c0) 00000020:00000080:3.0:1783967074.391712:0:17832:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783967074.391717:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1783967074.391844:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954560:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783967074.391915:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587954560 offset 0 length 520: 4 00000004:00080000:3.0:1783967074.392063:0:17832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783967074.392070:0:17832:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783967074.392078:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068098 00010000:00080000:3.0:1783967074.392107:0:17832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f4cb0000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967074.392316:0:17832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783967074.392395:0:17832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783967074.392411:0:17832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783967074.395717:0:17832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967074.399523:0:17832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783967074.399805:0:17832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783967074.402433:0:17839:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783967074.402443:0:17839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783967074.404475:0:17832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783967074.404495:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783967074.404550:0:17832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783967074.404578:0:17832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b31606809f 00000100:00080000:3.0:1783967074.404590:0:17832:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967074.404597:0:17832:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967074.404637:0:17832:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2de300 x1870624587954688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967074.404725:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954688:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783967074.404833:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587954688 offset 0 length 520: 4 00000100:00080000:3.0:1783967074.404914:0:17832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783967074.404970:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.404974:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.404976:0:17832:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783967074.404979:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967074.404983:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.404984:0:17832:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783967074.404987:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783967074.404989:0:17832:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783967074.404991:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.404993:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.404994:0:17832:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783967074.404996:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967074.404998:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.405000:0:17832:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783967074.405003:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783967074.405038:0:17832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967074.405048:0:17832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967074.405050:0:17832:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783967074.405053:0:17832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1783967074.405928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967074.405934:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967074.405937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967074.405940:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1783967074.408307:0:17828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1783967074.408374:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1783967074.408398:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.408412:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967074.408422:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c2f6c000 from 1 10000000:01000000:2.0:1783967074.408424:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783967074.408470:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.408477:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.408488:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967074.408513:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587954816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967074.408597:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.408648:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.409852:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954816 00000100:00100000:3.0:1783967074.409866:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954816 00000100:00100000:3.0:1783967074.409940:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783967074.409950:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+15:17828:x1870624587954816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967074.409968:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967074.409986:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160680a6 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.410014:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 16 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.410026:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 16 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.410035:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0800, rc 0) 00000100:00100000:3.0:1783967074.410107:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+16:17828:x1870624587954816:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.410114:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783967074.411368:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587954816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967074.411405:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.411450:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967074.412100:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587954944:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783967074.412195:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.412256:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47300 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.412498:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587954944 00000100:00100000:0.0:1783967074.412505:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587954944 00000100:00100000:0.0:1783967074.412559:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783967074.412569:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+16:17828:x1870624587954944:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783967074.412593:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783967074.412616:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783967074.412620:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783967074.412725:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+16:17828:x1870624587954944:12345-0@lo:256:mount.lustre.0 Request processed in 156us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.412733:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783967074.412946:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587954944:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783967074.415471:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783967074.415858:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.415874:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967074.415885:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c2f6c000 from 1 10000000:01000000:2.0:1783967074.415888:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783967074.415956:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.415965:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.415978:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967074.416012:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967074.416106:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.416346:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.424308:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955072 00000100:00100000:3.0:1783967074.424325:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955072 00000100:00100000:3.0:1783967074.424397:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783967074.424408:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+16:17828:x1870624587955072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967074.424426:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967074.424447:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160680b4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.424479:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.424513:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.424522:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00100000:3.0:1783967074.424657:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955072:12345-0@lo:101:mount.lustre.0 Request processed in 250us (8550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.424665:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783967074.430536:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967074.430566:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.430580:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783967074.430743:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967074.431572:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967074.431640:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967074.431739:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d47900 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.434317:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955200 00000100:00100000:3.0:1783967074.434338:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955200 00000100:00100000:3.0:1783967074.434421:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783967074.434433:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967074.434625:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955200:12345-0@lo:501:mount.lustre.0 Request processed in 194us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.434634:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967074.434759:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967074.434865:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967074.434930:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.434971:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967074.435047:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955328 00000100:00100000:1.0:1783967074.435052:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955328 00000100:00100000:1.0:1783967074.435081:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967074.435089:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967074.435207:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955328:12345-0@lo:503:mount.lustre.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.435214:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783967074.435924:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783967074.436397:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967074.436480:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967074.436534:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.436574:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967074.436712:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955456 00000100:00100000:1.0:1783967074.436718:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955456 00000100:00100000:1.0:1783967074.436749:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783967074.436757:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967074.436884:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955456:12345-0@lo:502:mount.lustre.0 Request processed in 128us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.436893:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967074.437108:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967074.437886:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783967074.437919:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1783967074.437936:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1783967074.437950:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1783967074.437962:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1783967074.437976:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1783967074.437989:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1783967074.438002:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1783967074.438013:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783967074.438025:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1783967074.438037:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1783967074.438066:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967074.438117:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.438402:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955584 00000100:00100000:1.0:1783967074.438408:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955584 00000100:00100000:1.0:1783967074.438455:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783967074.438465:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967074.438559:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955584:12345-0@lo:502:mount.lustre.0 Request processed in 96us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.438573:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967074.439218:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967074.439242:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967074.440272:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1783967074.440304:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783967074.449369:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967074.449386:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449390:0:17841:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783967074.449400:0:17841:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05c2f6c000 00000020:00000080:2.0:1783967074.449403:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967074.449413:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967074.449415:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449416:0:17841:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783967074.449418:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967074.449420:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449422:0:17841:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783967074.449424:0:17841:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05c2f6c000 00000020:00000080:2.0:1783967074.449426:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967074.449504:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967074.449508:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449510:0:17841:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783967074.449512:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967074.449515:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449516:0:17841:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967074.449538:0:17841:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05c2f6c000 00000020:00000080:2.0:1783967074.449540:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967074.449561:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967074.449564:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449565:0:17841:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967074.449568:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967074.449570:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449572:0:17841:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783967074.449575:0:17841:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05c2f6c000 00000020:00000080:2.0:1783967074.449578:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967074.449621:0:17841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967074.449625:0:17841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967074.449626:0:17841:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783967074.449630:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1783967074.459747:0:17828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783967074.459829:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783967074.459853:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.459867:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.459935:0:17828:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783967074.459939:0:17828:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05c2f6c000 10000000:01000000:1.0:1783967074.459943:0:17828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05c2f6c000 10000000:01000000:1.0:1783967074.459948:0:17828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783967074.459954:0:17828:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05c2f6c000 from 1 10000000:01000000:1.0:1783967074.459957:0:17828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783967074.460018:0:17828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460026:0:17828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460039:0:17828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967074.460069:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967074.460168:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.460211:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955712 00000100:00100000:1.0:1783967074.460218:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955712 00000100:00100000:1.0:1783967074.460273:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783967074.460291:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17828:x1870624587955712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967074.460304:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967074.460327:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274f000/0x9269c8b3160680c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160680c2 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460353:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274f000/0x9269c8b3160680c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160680c2 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460364:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274f000/0x9269c8b3160680c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680c2 expref: 18 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460373:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274f000, rc 0) 00000100:00100000:1.0:1783967074.460408:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587955712:12345-0@lo:101:mount.lustre.0 Request processed in 119us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.460415:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783967074.460470:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1000 going to sleep for 11 seconds 00000100:00100000:1.0:1783967074.460498:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967074.460514:0:17828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.460524:0:17828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967074.482521:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783967074.483272:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967074.484334:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783967074.484381:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1783967074.484400:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1783967074.484523:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1783967074.484543:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1783967074.484557:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1783967074.484570:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1783967074.484585:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1783967074.484603:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1783967074.484621:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1783967074.485063:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1783967074.485089:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1783967074.485110:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1783967074.485130:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1783967074.485149:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1783967074.485170:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1783967074.485190:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1783967074.485209:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1783967074.485227:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1783967074.485245:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1783967074.485270:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1783967074.485286:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1783967074.485315:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1783967074.485419:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1783967074.485443:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1783967074.485461:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1783967074.485474:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1783967074.485488:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1783967074.485515:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1783967074.485522:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783967074.485791:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967074.485865:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.485927:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.486175:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955840 00000100:00100000:2.0:1783967074.486184:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955840 00000100:00100000:2.0:1783967074.486249:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783967074.486259:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587955840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967074.486449:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587955840:12345-0@lo:501:mount.lustre.0 Request processed in 190us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.486459:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783967074.492412:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967074.492481:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967074.492567:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.492602:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.495554:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587955968 00000100:00100000:2.0:1783967074.495570:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587955968 00000100:00100000:2.0:1783967074.495647:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783967074.495659:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587955968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967074.495892:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587955968:12345-0@lo:503:mount.lustre.0 Request processed in 235us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.495901:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783967074.496843:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587955968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783967074.497313:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967074.497404:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967074.497471:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.497513:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.499305:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956096 00000100:00100000:2.0:1783967074.499328:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956096 00000100:00100000:2.0:1783967074.499392:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783967074.499403:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967074.499579:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956096:12345-0@lo:502:mount.lustre.0 Request processed in 177us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.499587:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967074.500512:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967074.500750:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783967074.500808:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1783967074.500825:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1783967074.500839:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1783967074.500851:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1783967074.500863:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1783967074.500877:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1783967074.500891:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1783967074.500919:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1783967074.500935:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1783967074.500949:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1783967074.500963:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1783967074.500975:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1783967074.500986:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1783967074.501009:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1783967074.501023:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1783967074.501035:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1783967074.501046:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1783967074.501059:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1783967074.501071:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1783967074.501084:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1783967074.501094:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1783967074.501105:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1783967074.501117:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1783967074.501548:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1783967074.501577:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1783967074.501592:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1783967074.501607:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1783967074.501620:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1783967074.501632:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1783967074.501645:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1783967074.501655:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1783967074.501667:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1783967074.501680:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1783967074.501691:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1783967074.501702:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1783967074.501713:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1783967074.501725:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1783967074.501737:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1783967074.501751:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1783967074.501833:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1783967074.501852:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1783967074.501864:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1783967074.501877:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1783967074.501891:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1783967074.501904:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1783967074.501919:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1783967074.501943:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1783967074.501998:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967074.502071:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.502112:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.502461:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956224 00000100:00100000:3.0:1783967074.502468:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956224 00000100:00100000:3.0:1783967074.503926:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783967074.503945:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967074.504119:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956224:12345-0@lo:502:mount.lustre.0 Request processed in 180us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.504128:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783967074.506188:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967074.506467:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1783967074.506498:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1783967074.506552:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967074.506636:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.509124:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.510000:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956352 00000100:00100000:2.0:1783967074.510012:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956352 00000100:00100000:2.0:1783967074.510072:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783967074.510083:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967074.510281:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956352:12345-0@lo:502:mount.lustre.0 Request processed in 199us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.510290:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967074.510473:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967074.510640:0:17828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1783967074.510658:0:17828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783967074.520174:0:17847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1783967074.520196:0:17847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a05f55f3380) 00000020:00000080:1.0:1783967074.520227:0:17847:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783967074.520463:0:17847:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05c2f6c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783967074.520468:0:17847:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05c2f6c000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1783967074.520471:0:17847:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05c2f6c000 3 00010000:00080000:1.0:1783967074.520518:0:17847:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05fcf70800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783967074.528136:0:17847:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1783967074.529748:0:17847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1783967074.531114:0:17847:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783967074.531133:0:17847:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9269c8b3160680d7 00000100:00080000:1.0:1783967074.531147:0:17847:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967074.531154:0:17847:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05fcf70800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967074.531194:0:17847:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e12a00 x1870624587956480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967074.531227:0:17847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783967074.532072:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587956480:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783967074.532163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783967074.544038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967074.544048:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967074.544051:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967074.544054:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967074.544083:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956480 00000100:00100000:1.0:1783967074.544093:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956480 00000100:00100000:1.0:1783967074.544154:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967074.544163:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587956480:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783967074.544195:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1783967074.544233:0:17097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9269c8b3160680de 00000004:00100000:1.0:1783967074.544268:0:17097:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783967074.544323:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf72000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967074.544407:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870624587956480:12345-0@lo:38:llog_process_th.0 Request processed in 244us (12243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.544414:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783967074.545017:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05f7e12a00 x1870624587956480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967074.545043:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783967074.545053:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783967074.545061:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783967074.545066:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783967074.545068:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783967074.545075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624587956480:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783967074.545275:0:17847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1783967074.545464:0:17828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783967074.545509:0:17828:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783967074.545531:0:17828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.545542:0:17828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783967074.545585:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783967074.545588:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783967074.545589:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967074.545590:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967074.545592:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967074.545593:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967074.545594:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967074.545596:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967074.545598:0:17828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967074.545606:0:17828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1783967074.545609:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783967074.545610:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783967074.545610:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967074.545611:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967074.545612:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967074.545613:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967074.545614:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967074.545615:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967074.545616:0:17828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967074.545636:0:17828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783967074.545653:0:17828:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783967074.545721:0:17828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.545751:0:17828:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d176d600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967074.546137:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956608 00000100:00100000:2.0:1783967074.546155:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956608 00000100:00100000:2.0:1783967074.546200:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783967074.546210:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783967074.546234:0:17091:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783967074.546250:0:17091:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1783967074.557615:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783967074.559215:0:17091:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783967074.559237:0:17091:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783967074.559368:0:17111:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783967074.559373:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783967074.559402:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559426:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559434:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559442:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559502:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559519:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967074.559547:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587956736:0@lo:104: 00000100:00100000:0.0:1783967074.559663:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783967074.559741:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559750:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 18 pid: 17091 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967074.559759:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587956864:0@lo:104: 00000100:00100000:0.0:1783967074.559797:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.559816:0:17111:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c516e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967074.559823:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956736 00000100:00100000:3.0:1783967074.559832:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956736 00000100:00100000:0.0:1783967074.559837:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956864 00000100:00100000:0.0:1783967074.559840:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956864 00000100:00100000:0.0:1783967074.559874:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967074.559884:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587956736:12345-0@lo:104: 00010000:00010000:0.0:1783967074.559899:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.559965:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783967074.559972:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587956736:12345-0@lo:104: Request processed in 89us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.559981:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967074.560001:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967074.560007:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587956864:12345-0@lo:104: 00010000:00010000:0.0:1783967074.560014:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.560060:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783967074.560065:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587956864:12345-0@lo:104: Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.560072:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783967074.560094:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967074.560102:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967074.560108:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587956736:0@lo:104: 00010000:00010000:3.0:1783967074.560110:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967074.560114:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967074.560116:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587956864:0@lo:104: 00010000:00010000:3.0:1783967074.560124:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967074.560131:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967074.560138:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783967074.560140:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.560156:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967074.560175:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.560182:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967074.560209:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.560216:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631c00/0x9269c8b3160680a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680ad expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.560229:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967074.560231:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967074.560233:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967074.560267:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587956992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967074.560298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967074.575306:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17828:x1870624587956608:12345-0@lo:253:mount.lustre.0 Request processed in 26274us (26760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967074.575332:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967074.575474:0:17828:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:17828:1870624587956608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783967074.575501:0:17828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1783967074.575505:0:17828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783967074.575507:0:17828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783967074.575509:0:17828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967074.575510:0:17828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967074.575511:0:17828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967074.575512:0:17828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967074.575514:0:17828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967074.575515:0:17828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967074.575517:0:17828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783967074.575533:0:17828:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1783967074.577989:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587956992 00000100:00100000:2.0:1783967074.578007:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587956992 00010000:00010000:2.0:1783967074.578049:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967074.578104:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967074.578115:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+18:3645:x1870624587956992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967074.578130:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967074.578159:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.578172:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.578194:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0800/0x9269c8b3160680ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160680a6 expref: 18 pid: 17090 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967074.578213:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967074.578303:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+17:3645:x1870624587956992:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (18002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967074.578311:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783967074.583090:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967074.583107:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.583123:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967074.583128:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.583142:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967074.583153:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967074.583160:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783967074.583228:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.583235:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783967074.584035:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587956992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967074.584060:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967074.584071:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587957120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967074.584135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967074.584166:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957120 00000100:00100000:3.0:1783967074.584174:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957120 00010000:00010000:3.0:1783967074.584203:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 17 pid: 17091 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.585978:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.585993:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631800/0x9269c8b316067fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fe9 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967074.586021:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967074.586024:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967074.586027:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967074.586039:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967074.586042:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967074.595753:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783967074.595799:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+17:3645:x1870624587957120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967074.595827:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967074.595839:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 17 pid: 17091 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595858:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 17 pid: 17091 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595912:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fe00/0x9269c8b316067fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316067fe2 expref: 17 pid: 17091 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595935:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595944:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783967074.595963:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036591042s 00010000:00010000:3.0:1783967074.595968:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595977:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595984:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595990:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.595997:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967074.596002:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.596009:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.596032:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967074.596050:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967074.596143:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+16:3645:x1870624587957120:12345-0@lo:103:ldlm_bl.0 Request processed in 375us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967074.596152:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967074.596255:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587957120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967074.596327:0:17111:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.596336:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967074.596350:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0200/0x9269c8b3160680e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1783967074.601006:0:17828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1783967074.601054:0:17853:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783967074.601060:0:17853:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1783967074.602736:0:17854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783967074.602975:0:17828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1783967074.603322:0:17854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783967074.604593:0:17855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.604665:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1783967074.604680:0:17828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1783967074.604696:0:17855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b480 going to sleep for 11 seconds 00000040:00080000:0.0:1783967074.604719:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783967074.605034:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957248 00000100:00100000:1.0:1783967074.605041:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957248 00000100:00100000:1.0:1783967074.605084:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967074.605093:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.605171:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (505us total) trans 0 rc 0/0 00000004:00000080:0.0:1783967074.605177:0:17828:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1783967074.605179:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:0.0:1783967074.605184:0:17828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1783967074.605216:0:17855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957248:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783967074.605222:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783967074.605255:0:17855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783967074.605288:0:17855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.605497:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.605517:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957376 00000100:00100000:1.0:1783967074.605521:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957376 00000100:00100000:1.0:1783967074.605855:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967074.605864:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.606077:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 215us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.606084:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967074.606100:0:17855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783967074.606113:0:17855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957376:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1783967074.606208:0:17828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783967074.606859:0:17828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783967074.606887:0:17828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1783967074.606983:0:17828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1783967074.607485:0:17828:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1783967074.607932:0:17855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17855:1870624587957504:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.607997:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.608047:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957504 00000100:00100000:1.0:1783967074.608052:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957504 00000100:00100000:1.0:1783967074.608088:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783967074.608096:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17855:x1870624587957504:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.608143:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17855:x1870624587957504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 47us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.608151:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783967074.608178:0:17855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18be40 going to sleep for 11 seconds 00010000:00080000:1.0:1783967074.608197:0:17855:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05f7e10700 x1870624587957504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967090 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967074.608210:0:17855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17855:1870624587957504:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.608277:0:17855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.608304:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967074.608324:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957632 00000100:00100000:1.0:1783967074.608328:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957632 00000100:00100000:1.0:1783967074.608347:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967074.608353:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783967074.608421:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17855:x1870624587957632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967074.608427:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967074.608442:0:17855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b480 going to sleep for 11 seconds 00000100:00100000:1.0:1783967074.608455:0:17855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17855:1870624587957632:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783967074.608498:0:17855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967074.612160:0:17854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783967074.612269:0:17854:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783967074.615125:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783967074.615226:0:17855:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783967074.615232:0:17855:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1783967074.620326:0:17828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783967074.643090:0:17828:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783967074.643135:0:17828:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb71ec0dab988 00100000:10000000:2.0:1783967074.643154:0:17828:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783967074.646241:0:17828:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783967074.646294:0:17828:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783967074.646317:0:17828:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783967074.646338:0:17828:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783967074.647285:0:17828:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967074.647518:0:17828:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783967074.874666:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967075.255441:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000040:00080000:1.0:1783967075.579275:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967075.894947:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783967076.023139:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967076.023152:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c2f6c000 from 8 10000000:01000000:0.0:1783967076.023159:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967076.023243:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.023258:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.023272:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967076.023346:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587957760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967076.023457:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967076.023540:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c1254600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967076.023661:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957760 00000100:00100000:2.0:1783967076.023671:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957760 00000100:00100000:2.0:1783967076.023745:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783967076.023757:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+16:17093:x1870624587957760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967076.023812:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967076.023831:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160680ec expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967076.023876:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160680ec expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967076.023890:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680ec expref: 17 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967076.023901:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630000, rc 0) 00000100:00100000:2.0:1783967076.023961:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587957760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967076.023969:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783967076.024114:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587957760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967076.024133:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.024143:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967076.024206:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587957888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783967076.024268:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967076.024303:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c1254600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967076.024451:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587957888 00000100:00100000:2.0:1783967076.024456:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587957888 00000100:00100000:2.0:1783967076.024493:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783967076.024501:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587957888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783967076.024517:0:17091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783967076.024538:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783967076.024541:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1783967076.024638:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587957888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967076.024646:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783967076.024719:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587957888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783967076.024905:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783967076.024914:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.024922:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967076.024932:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967076.024936:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05fcff7800 from 8 10000000:01000000:0.0:1783967076.024939:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967076.024962:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.024980:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967076.024990:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967076.025005:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587958016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967076.025033:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967076.025061:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967076.025127:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958016 00000100:00100000:3.0:1783967076.025133:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958016 00000100:00100000:3.0:1783967076.025170:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783967076.025178:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587958016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967076.025189:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967076.025204:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160680fa expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967076.025223:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160680fa expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967076.025243:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680fa expref: 18 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967076.025252:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1600, rc 0) 00000100:00100000:3.0:1783967076.025346:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587958016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967076.025352:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783967076.027135:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587958016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967076.027167:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967076.027179:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967076.027287:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587958144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783967076.027374:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967076.027482:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967076.027575:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958144 00000100:00100000:3.0:1783967076.027590:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958144 00000100:00100000:3.0:1783967076.027705:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783967076.027715:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587958144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783967076.027742:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783967076.027762:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783967076.027765:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783967076.027897:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587958144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 183us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967076.027907:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783967076.028011:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587958144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783967076.028074:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783967076.028083:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967076.028094:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967076.278947:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000040:00080000:1.0:1783967076.600075:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967076.919010:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967077.302860:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:3.0:1783967077.947976:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967078.269992:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967078.339399:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00010000:00010000:1.0:1783967078.969220:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967079.353244:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 0 seconds 00000100:00100000:3.0:1783967079.800605:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587958272:0@lo:400:kworker.0 00000100:00100000:3.0:1783967079.800692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783967079.800766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783967079.800786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783967079.800805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967079.800815:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c32fe800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967079.800840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e13480 x1870624587958400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967079.800857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967079.800861:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967079.800864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967079.800867:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967079.811517:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587958656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967079.811592:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967079.811663:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958656 00000100:00100000:2.0:1783967079.811670:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958656 00000100:00100000:2.0:1783967079.811715:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967079.811724:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587958656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967079.811789:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783967079.811838:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587958656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967079.811845:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967079.811897:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587958656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967079.811997:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967079.812007:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587958528:0@lo:400:kworker.0 00000100:00100000:3.0:1783967079.812054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967079.812094:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958272 00000100:00100000:3.0:1783967079.812099:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958272 00000100:00100000:3.0:1783967079.812127:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783967079.812133:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:3647:x1870624587958272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967079.812183:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:3647:x1870624587958272:12345-0@lo:400:kworker.0 Request processed in 50us (11491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967079.812190:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783967079.812235:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587958272:0@lo:400:kworker.0 00000100:00100000:3.0:1783967079.812278:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587958400:0@lo:38:kworker.0 00000100:00100000:3.0:1783967079.812312:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967079.813898:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958528 00000100:00100000:2.0:1783967079.813911:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958528 00000100:00100000:2.0:1783967079.813976:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967079.813985:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587958528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967079.814473:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587958528:12345-0@lo:400:kworker.0 Request processed in 487us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967079.814482:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967079.814518:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958400 00000100:00100000:2.0:1783967079.814522:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958400 00000100:00100000:2.0:1783967079.814545:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967079.814550:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624587958400:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783967079.814576:0:17100:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1783967079.814618:0:17100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316068108 00000004:00100000:2.0:1783967079.814635:0:17100:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783967079.814642:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1783967079.814743:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f7e10a80 x1870624587958528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967079.814757:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587958528:0@lo:400:kworker.0 00000100:00080000:1.0:1783967079.814895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967079.814900:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967079.814903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967079.814906:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967079.815426:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587958784:0@lo:400:kworker.0 00000100:00100000:2.0:1783967079.815497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967079.816571:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958784 00000100:00100000:1.0:1783967079.816580:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958784 00000100:00100000:1.0:1783967079.816625:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967079.816634:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587958784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967079.816709:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587958784:12345-0@lo:400:kworker.0 Request processed in 77us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967079.816717:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783967079.816856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05f7e12d80 x1870624587958784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967079.816869:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587958784:0@lo:400:kworker.0 00000100:00080000:0.0:1783967079.839926:0:17100:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967079.840025:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587958400:12345-0@lo:38:kworker.0 Request processed in 25472us (27710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967079.840050:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1783967079.840401:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783967079.840412:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783967079.840417:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783967079.840420:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783967079.840445:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000939138e5): req@ffff9a05ef2dce00 x1870624587951104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967079.840465:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587958400:0@lo:38:kworker.0 00000100:00100000:2.0:1783967079.840538:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967079.840573:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657180 going to sleep for 11 seconds 00000100:00100000:2.0:1783967079.840588:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587951104 00000100:00100000:2.0:1783967079.840594:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587951104 00000100:00100000:2.0:1783967079.840630:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967079.840640:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587951104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.840707:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587951104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967079.840715:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967079.840739:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1870624587951104:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1783967079.840794:0:17137:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1783967079.840849:0:17137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1870624587958912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.840882:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967079.840902:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967079.840913:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587958912 00000100:00100000:2.0:1783967079.840916:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587958912 00000100:00100000:2.0:1783967079.840933:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967079.840938:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587958912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.841079:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587958912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 140us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967079.841086:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967079.841112:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1870624587958912:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.841187:0:17137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1870624587959040:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.841396:0:17137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967079.841412:0:17137:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231000 going to sleep for 11 seconds 00000100:00100000:2.0:1783967079.841424:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959040 00000100:00100000:2.0:1783967079.841427:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959040 00000100:00100000:2.0:1783967079.841445:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783967079.841451:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587959040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967079.841498:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17137:x1870624587959040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967079.841504:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783967079.841529:0:17137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17137:1870624587959040:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1783967079.841568:0:17137:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967079.843000:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967079.843016:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587959168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967079.843094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967079.843137:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959168 00000100:00100000:0.0:1783967079.843142:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959168 00000100:00100000:0.0:1783967079.843183:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783967079.843192:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587959168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967079.844238:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967079.844312:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587959168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1120us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967079.844321:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783967079.844382:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587959168:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783967079.855497:0:17137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783967079.855584:0:17137:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:2.0:1783967079.855589:0:17137:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1783967079.994699:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967081.018130:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783967081.254475:0:18098:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783967082.040418:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783967082.465705:0:18150:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967082.466101:0:18150:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783967082.872156:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967067/real 1783967067] req@ffff9a05d8acbb80 x1870624587952128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967082.872189:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05d8acbb80 x1870624587952128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967082.872198:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967067/real 1783967067] req@ffff9a05d8ac9880 x1870624587952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967082 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967082.872211:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05d8ac9880 x1870624587952384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967082 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783967082.872231:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967082.872249:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783967082.872253:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952128:0@lo:8:kworker.0 00000100:00080000:3.0:1783967082.872259:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967082.872264:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783967082.872267:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587952384:0@lo:8:kworker.0 00000100:00080000:0.0:1783967082.872584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967082.872589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783967082.872591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967082.872596:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:0.0:1783967082.872601:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967082.872608:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a05f1ac5000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967082.872627:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3aa00 x1870624587959552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967082.872641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967082.872644:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967082.872646:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967082.872648:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:0.0:1783967082.872651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967082.872654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967082.872665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e39f80 x1870624587959680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967082.872686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967082.872689:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967082.872692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967082.872695:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967082.872722:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587959936:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.872839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967082.872872:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783967082.872879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587959296:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.872912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967082.872940:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587960064:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.872981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967082.873030:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587959424:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967082.873073:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783967082.873077:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587959808:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967082.873139:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959936 00000100:00100000:0.0:1783967082.873147:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959936 00000100:00100000:0.0:1783967082.873192:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959424 00000100:00100000:0.0:1783967082.873196:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959424 00000100:00100000:0.0:1783967082.873213:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967082.873221:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587959936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873275:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587959936:12345-0@lo:400:kworker.0 Request processed in 54us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967082.873284:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967082.873301:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967082.873307:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587959424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873337:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624587959424:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967082.873343:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967082.873361:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959296 00000100:00100000:0.0:1783967082.873372:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959296 00000100:00100000:0.0:1783967082.873400:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783967082.873406:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:3647:x1870624587959296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873437:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:3647:x1870624587959296:12345-0@lo:400:kworker.0 Request processed in 31us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967082.873443:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783967082.873474:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960064 00000100:00100000:0.0:1783967082.873478:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960064 00000100:00100000:0.0:1783967082.873500:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587959808 00000100:00100000:0.0:1783967082.873503:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587959808 00000100:00100000:0.0:1783967082.873515:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967082.873521:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587960064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873550:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624587960064:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967082.873556:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967082.873568:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967082.873573:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873600:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587959808:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967082.873606:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783967082.873648:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3e3ad80 x1870624587959808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967082.873660:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587959808:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873672:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587959424:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873697:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587959552:0@lo:8:kworker.0 00000400:00000100:0.0:1783967082.873729:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587959552 offset 0 length 520: 4 00000100:00100000:0.0:1783967082.873742:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587959680:0@lo:8:kworker.0 00000400:00000100:0.0:1783967082.873756:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587959680 offset 0 length 520: 4 00000100:00100000:0.0:1783967082.873807:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587959296:0@lo:400:kworker.0 00010000:00080000:0.0:1783967082.873818:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3e3bb80 x1870624587960064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967082.873827:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624587960064:0@lo:400:kworker.0 00000100:00100000:0.0:1783967082.873837:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587959936:0@lo:400:kworker.0 00010000:00010000:2.0:1783967083.062954:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783967083.408087:0:18200:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783967083.408303:0:18200:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967084.087567:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783967084.415279:0:18248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2be8ce00 20000000:00000080:2.0:1783967084.415305:0:18248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05c6a85800 uarg=0000000000000000 20000000:01000000:2.0:1783967084.415346:0:18248:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783967084.415354:0:18248:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783967084.415359:0:18248:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783967084.418346:0:18249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1783967084.418650:0:18248:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783967084.430215:0:18248:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783967084.435851:0:18248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.435887:0:18248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.435897:0:18248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.435906:0:18248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.435966:0:18248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.435983:0:18248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967084.436020:0:18248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18248:1870624587960192:0@lo:104: 00000100:00100000:0.0:1783967084.436106:0:18248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783967084.436177:0:18248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.436186:0:18248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 17 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967084.436194:0:18248:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18248:1870624587960320:0@lo:104: 00000100:00100000:0.0:1783967084.436217:0:18248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967084.436239:0:18248:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c2d4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967084.436380:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960192 00000100:00100000:1.0:1783967084.436389:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960192 00000100:00100000:1.0:1783967084.436450:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960320 00000100:00100000:1.0:1783967084.436453:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960320 00000100:00100000:1.0:1783967084.436478:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967084.436497:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+4:18248:x1870624587960192:12345-0@lo:104: 00010000:00010000:1.0:1783967084.436511:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436574:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783967084.436579:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+4:18248:x1870624587960192:12345-0@lo:104: Request processed in 85us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967084.436586:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967084.436602:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967084.436609:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:18248:x1870624587960320:12345-0@lo:104: 00010000:00010000:1.0:1783967084.436616:0:17079:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436648:0:17079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783967084.436653:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3b28c549-2862-472c-a00b-4682deda9da4+3:18248:x1870624587960320:12345-0@lo:104: Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967084.436659:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783967084.436688:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967084.436695:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436704:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967084.436709:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436718:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967084.436750:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967084.436756:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967084.436827:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436834:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967084.436862:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436871:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630600/0x9269c8b3160680b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680bb expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436889:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967084.436893:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436899:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630800 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967084.436902:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436909:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967084.436916:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967084.436921:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967084.436941:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436947:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967084.436954:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436961:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630800/0x9269c8b316067fb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316067fb8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.436973:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967084.436975:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967084.436976:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967084.436983:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967084.437001:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967084.437032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967084.437071:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967084.437085:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967084.437108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967084.437141:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960448 00000100:00100000:1.0:1783967084.437145:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960448 00010000:00010000:1.0:1783967084.437167:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 18 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967084.437188:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960576 00000100:00100000:1.0:1783967084.437191:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960576 00010000:00010000:1.0:1783967084.437203:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 19 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967084.437215:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967084.437221:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+19:3645:x1870624587960448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967084.437239:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967084.437246:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 19 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437256:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 19 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437273:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967084.437301:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+19:3645:x1870624587960448:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967084.437307:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967084.437323:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967084.437330:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+18:3645:x1870624587960576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967084.437337:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967084.437342:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 18 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437350:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 18 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437362:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437370:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437383:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437391:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437404:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437411:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437418:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967084.437422:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437430:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437438:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967084.437448:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967084.437471:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+18:3645:x1870624587960576:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967084.437477:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967084.437514:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967084.437523:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967084.438129:0:18248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0000/0x9269c8b3160680bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160680b4 expref: 17 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967084.438144:0:18248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18248:1870624587960192:0@lo:104: 00010000:00010000:0.0:1783967084.438153:0:18248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0400/0x9269c8b316067fb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316067fb1 expref: 16 pid: 17091 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967084.438160:0:18248:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18248:1870624587960320:0@lo:104: 00010000:00010000:0.0:1783967084.438176:0:18248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.438185:0:18248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.438191:0:18248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967084.438210:0:18248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0c00/0x9269c8b31606810f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967084.919473:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587960704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967084.919556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967084.919610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967084.919616:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587960832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967084.919639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967084.919680:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960704 00000100:00100000:2.0:1783967084.919689:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960704 00000100:00100000:2.0:1783967084.919728:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960832 00000100:00100000:2.0:1783967084.919730:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960832 00000100:00100000:2.0:1783967084.919747:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967084.919755:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587960704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967084.919824:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967084.919846:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967074/real 1783967074] req@ffff9a05ef2de300 x1870624587954688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967084.919872:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05ef2de300 x1870624587954688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967084.919900:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967074/real 1783967074] req@ffff9a05ef2ded80 x1870624587954560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967084.919913:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05ef2ded80 x1870624587954560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783967084.919929:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967084.919965:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967084.919969:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954688:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783967084.919975:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967084.919980:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967084.919984:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587954560:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783967084.923510:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587960704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3743us (3943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967084.923526:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967084.923564:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967084.923575:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587960832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967084.923608:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783967084.923649:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587960832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967084.923655:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783967084.923725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967084.923729:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967084.923732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967084.923735:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967084.923745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967084.923749:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783967084.923751:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967084.923756:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:2.0:1783967084.923760:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967084.923766:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05ee18b000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967084.923802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05d8acbb80 x1870624587961216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967084.923816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967084.923819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783967084.923821:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967084.923824:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:2.0:1783967084.923827:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967084.923830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967084.923841:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c372a300 x1870624587961344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967084.924089:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960960:0@lo:400:kworker.0 00000100:00100000:1.0:1783967084.924137:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967084.924179:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967084.924186:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587961088:0@lo:400:kworker.0 00000100:00100000:2.0:1783967084.924193:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587960960 00000100:00100000:2.0:1783967084.924200:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587960960 00000100:00100000:1.0:1783967084.924210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967084.924235:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967084.924243:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+16:3645:x1870624587960960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967084.924243:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961088 00000100:00100000:1.0:1783967084.924246:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961088 00000100:00100000:2.0:1783967084.924289:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+16:3645:x1870624587960960:12345-0@lo:400:kworker.0 Request processed in 47us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967084.924296:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783967084.926823:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967084.926848:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587961088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967084.926960:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587961088:12345-0@lo:400:kworker.0 Request processed in 113us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967084.926969:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967084.929234:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967084.929261:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587961472:0@lo:400:kworker.0 00000100:00100000:0.0:1783967084.929335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967084.930298:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587961216:0@lo:8:kworker.0 00000400:00000100:0.0:1783967084.930337:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587961216 offset 0 length 520: 4 00000100:00100000:0.0:1783967084.930358:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587961344:0@lo:8:kworker.0 00000400:00000100:0.0:1783967084.930385:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624587961344 offset 0 length 520: 4 00000100:00100000:0.0:1783967084.930453:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587960832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967084.930467:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587960704:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1783967084.930513:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05d8ac9880 x1870624587961088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967084.930524:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587961088:0@lo:400:kworker.0 00000100:00100000:0.0:1783967084.930534:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587960960:0@lo:400:kworker.0 00000100:00100000:2.0:1783967084.930843:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961472 00000100:00100000:2.0:1783967084.930851:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961472 00000100:00100000:0.0:1783967084.931128:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783967084.931136:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587961472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967084.931205:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587961472:12345-0@lo:400:kworker.0 Request processed in 69us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967084.931212:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783967084.931242:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3729180 x1870624587961472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967084.931277:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587961472:0@lo:400:kworker.0 00010000:00010000:2.0:1783967085.111145:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783967085.943821:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783967085.943843:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c2f6c000 from 13 10000000:01000000:1.0:1783967085.943849:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783967085.943900:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.943912:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.943923:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967085.943951:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783967085.944030:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967085.944080:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967085.944141:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961600 00000100:00100000:3.0:1783967085.944149:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961600 00000100:00100000:3.0:1783967085.944215:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783967085.944225:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+16:17093:x1870624587961600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967085.944241:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967085.944263:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068116 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.944286:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068116 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.944296:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068116 expref: 17 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.944308:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1200, rc 0) 00000100:00100000:3.0:1783967085.944350:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967085.944357:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783967085.944436:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967085.944450:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.944459:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967085.944523:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967085.944550:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967085.944579:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967085.946244:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961728 00000100:00100000:3.0:1783967085.946257:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961728 00000100:00100000:3.0:1783967085.946326:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783967085.946336:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967085.946510:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967085.946518:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783967085.946696:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967085.946757:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967085.946847:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967085.946880:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967085.946997:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961856 00000100:00100000:3.0:1783967085.947002:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961856 00000100:00100000:3.0:1783967085.947036:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783967085.947043:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967085.947131:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967085.947138:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783967085.947508:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783967085.950284:0:18317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783967085.950714:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783967085.950756:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967085.950791:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.950805:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967085.950816:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783967085.950819:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff7800 from 13 10000000:01000000:3.0:1783967085.950822:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967085.950859:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.950866:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967085.950876:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967085.950902:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967085.950971:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967085.951007:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d176d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967085.951722:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587961984 00000100:00100000:1.0:1783967085.951732:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587961984 00000100:00100000:1.0:1783967085.951796:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967085.951807:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+17:17093:x1870624587961984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967085.951822:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967085.951836:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068124 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.951858:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068124 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.951868:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068124 expref: 18 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967085.951875:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e800, rc 0) 00000100:00100000:1.0:1783967085.951932:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587961984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967085.951939:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783967085.953269:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587961984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967085.953295:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967085.953307:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967085.953393:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967085.953446:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967085.953472:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334180 going to sleep for 11 seconds 00000100:00100000:0.0:1783967085.953495:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962112 00000100:00100000:0.0:1783967085.953499:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962112 00000100:00100000:0.0:1783967085.953539:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783967085.953563:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587962112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967085.953693:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587962112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967085.953700:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783967085.953734:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587962112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967085.953764:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587962240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967085.953828:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967085.953842:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334180 going to sleep for 11 seconds 00000100:00100000:0.0:1783967085.953852:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962240 00000100:00100000:0.0:1783967085.953861:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962240 00000100:00100000:0.0:1783967085.953882:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783967085.953889:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587962240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967085.953962:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:17093:x1870624587962240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967085.953968:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783967085.954006:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587962240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783967085.954655:0:18318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783967085.954722:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783967085.954740:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783967085.954750:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967085.954759:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783967085.963614:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1783967086.137377:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967086.846201:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967087.163480:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967088.186197:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967088.503407:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967089.207308:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967090.038959:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967090.038993:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587962368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967090.039144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967090.039198:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962368 00000100:00100000:0.0:1783967090.039205:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962368 00000100:00100000:0.0:1783967090.039249:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967090.039259:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587962368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967090.039294:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783967090.039357:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587962368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967090.039365:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967090.039409:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587962368:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783967090.041131:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967090.041137:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967090.041140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967090.041143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967090.041153:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967090.041156:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967090.041158:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967090.041161:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967090.041188:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587962624:0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967090.041295:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783967090.041301:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587962496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967090.041325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967090.041340:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587963008:0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967090.041383:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587962880:0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041409:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967090.041454:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783967090.041460:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587962752:0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967090.041513:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963008 00000100:00100000:2.0:1783967090.041520:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963008 00000100:00100000:2.0:1783967090.041568:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962880 00000100:00100000:2.0:1783967090.041572:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962880 00000100:00100000:2.0:1783967090.041681:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967090.041688:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587963008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041737:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587963008:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967090.041746:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967090.041764:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967090.041790:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587962880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.041820:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587962880:12345-0@lo:400:kworker.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967090.041826:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783967090.041867:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c372a680 x1870624587962880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967090.041879:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587962880:0@lo:400:kworker.0 00010000:00080000:2.0:1783967090.041902:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3729c00 x1870624587963008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967090.041911:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587963008:0@lo:400:kworker.0 00000100:00100000:0.0:1783967090.043007:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962624 00000100:00100000:0.0:1783967090.043018:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962624 00000100:00100000:0.0:1783967090.043073:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783967090.043083:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:3646:x1870624587962624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.043150:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962496 00000100:00100000:2.0:1783967090.043156:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962496 00000100:00100000:2.0:1783967090.043179:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587962752 00000100:00100000:2.0:1783967090.043193:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587962752 00000100:00100000:2.0:1783967090.043210:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967090.043216:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587962496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967090.043252:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967090.043314:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587962496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967090.043321:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967090.043336:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783967090.043342:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587962752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.043376:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587962752:12345-0@lo:400:kworker.0 Request processed in 34us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967090.043382:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783967090.043424:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587962752:0@lo:400:kworker.0 00000100:00100000:2.0:1783967090.043461:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587962496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967090.043531:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+18:3646:x1870624587962624:12345-0@lo:400:kworker.0 Request processed in 450us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967090.043540:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783967090.043558:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587962624:0@lo:400:kworker.0 00010000:00010000:1.0:1783967090.231737:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967091.256076:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783967091.845463:0:18597:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783967091.845467:0:18597:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783967091.845469:0:18597:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783967091.845576:0:18597:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05f571a000 00000020:01000004:3.0:1783967091.845593:0:18597:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783967091.845608:0:18597:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783967091.845623:0:18597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a05ea23b380) 00000020:00000080:3.0:1783967091.845642:0:18597:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783967091.909047:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783967091.910846:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783967091.911102:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783967091.911633:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783967091.911897:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783967091.912189:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783967091.912428:0:18597:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1783967091.914654:0:18597:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783967091.914971:0:18597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783967091.914983:0:18597:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783967091.914996:0:18597:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b316068139 00000020:01000004:0.0:1783967091.915003:0:18597:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783967091.915027:0:18597:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783967091.915031:0:18597:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783967091.915037:0:18597:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783967091.915043:0:18597:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783967091.915055:0:18597:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a05c34ccd40) 00000020:00000080:0.0:1783967091.915076:0:18597:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1783967091.916310:0:18597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967091.916470:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783967091.916477:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783967091.923815:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783967091.923833:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783967091.932094:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783967091.932109:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783967091.936947:0:18597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967091.937164:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783967091.937171:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783967091.940811:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783967091.940825:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783967091.975915:0:18597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967091.976259:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783967091.976267:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783967091.977738:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783967091.977756:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783967091.978648:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783967091.978656:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783967091.981020:0:18597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967091.981268:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783967091.981274:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783967091.981991:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783967091.982000:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783967092.057433:0:18597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967092.057712:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783967092.057719:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783967092.061262:0:18597:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783967092.061279:0:18597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783967092.068340:0:18597:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783967092.068380:0:18597:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783967092.068388:0:18597:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783967092.094511:0:18597:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783967092.094579:0:18597:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783967092.094583:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783967092.094589:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967092.094590:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967092.094602:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967092.094604:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967092.094605:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967092.094607:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967092.094609:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967092.094610:0:18597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967092.094614:0:18597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783967092.094616:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967092.094618:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967092.094619:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967092.094620:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967092.094621:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967092.094622:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967092.094623:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967092.094624:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967092.094624:0:18597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967092.094649:0:18597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783967092.094669:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967092.094740:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.095074:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963136 00000100:00100000:3.0:1783967092.095083:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963136 00000100:00100000:3.0:1783967092.095154:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783967092.095165:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:18597:x1870624587963136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783967092.095220:0:17089:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783967092.095224:0:17089:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783967092.095227:0:17089:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783967092.095465:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c55586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967092.098079:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:18597:x1870624587963136:12345-0@lo:253:mount.lustre.0 Request processed in 2908us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.098093:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783967092.098257:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783967092.098288:0:18597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783967092.098292:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783967092.098294:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967092.098295:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967092.098296:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967092.098297:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967092.098299:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967092.098300:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967092.098302:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967092.098304:0:18597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783967092.098329:0:18597:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05f571a000 from lustre-OST0000 10000000:01000000:2.0:1783967092.098364:0:18597:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783967092.098367:0:18597:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783967092.098375:0:18597:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 00010000:00010000:2.0:1783967092.098400:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967092.098517:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967092.098568:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.098618:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783967092.098745:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963264 00000100:00100000:1.0:1783967092.098751:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963264 00000100:00100000:1.0:1783967092.098823:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783967092.098833:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:18597:x1870624587963264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967092.098946:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+18:18597:x1870624587963264:12345-0@lo:501:mount.lustre.0 Request processed in 114us (376us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783967092.098954:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783967092.099401:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963264:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783967092.099418:0:18597:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783967092.099454:0:18597:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783967092.099461:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967092.099470:0:18597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967092.099495:0:18597:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05f571a000 10000000:01000000:3.0:1783967092.099500:0:18597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783967092.099505:0:18597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783967092.099507:0:18597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967092.099512:0:18597:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783967092.099520:0:18597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783967092.099545:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967092.099552:0:18597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967092.099561:0:18597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967092.099575:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967092.099619:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.099643:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967092.099883:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963392 00000100:00100000:1.0:1783967092.099888:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963392 00000100:00100000:1.0:1783967092.099927:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783967092.099945:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+18:18597:x1870624587963392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967092.099955:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967092.099967:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274fe00/0x9269c8b31606814e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068147 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.099986:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274fe00/0x9269c8b31606814e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068147 expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.099995:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274fe00/0x9269c8b31606814e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068147 expref: 19 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.100003:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274fe00, rc 0) 00000100:00100000:1.0:1783967092.100039:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963392:12345-0@lo:101:mount.lustre.0 Request processed in 97us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.100045:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783967092.100727:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967092.100744:0:18597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967092.100755:0:18597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967092.102801:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783967092.103697:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967092.108133:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783967092.108219:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783967092.108237:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783967092.108252:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783967092.111041:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783967092.111127:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783967092.111162:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783967092.111167:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783967092.111327:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967092.111401:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.111453:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.111875:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963520 00000100:00100000:2.0:1783967092.111883:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963520 00000100:00100000:2.0:1783967092.111952:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783967092.111965:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967092.112149:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963520:12345-0@lo:501:mount.lustre.0 Request processed in 186us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.112158:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783967092.112469:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967092.112509:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967092.112553:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.112583:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.112727:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963648 00000100:00100000:2.0:1783967092.112732:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963648 00000100:00100000:2.0:1783967092.112802:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783967092.112811:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967092.113727:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963648:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.113737:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783967092.113863:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967092.114336:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967092.114428:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967092.114750:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.114969:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967092.120541:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963776 00000100:00100000:1.0:1783967092.120560:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963776 00000100:00100000:1.0:1783967092.121148:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783967092.121163:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967092.123300:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963776:12345-0@lo:502:mount.lustre.0 Request processed in 2132us (8539us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.123330:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783967092.131144:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967092.132586:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783967092.132705:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783967092.132723:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783967092.132737:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783967092.132751:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783967092.132765:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783967092.132861:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783967092.132906:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783967092.132923:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783967092.132949:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783967092.133090:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783967092.133111:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783967092.133163:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967092.133418:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.133601:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.133693:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587963904 00000100:00100000:2.0:1783967092.133701:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587963904 00000100:00100000:2.0:1783967092.135071:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783967092.135090:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967092.135712:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587963904:12345-0@lo:502:mount.lustre.0 Request processed in 627us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.135722:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783967092.136059:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587963904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967092.136381:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783967092.136395:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783967092.138662:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783967092.138675:0:18614:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783967092.138683:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.138685:0:18614:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783967092.138692:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783967092.138709:0:18614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a04c34799c0) 00000020:00000080:2.0:1783967092.138739:0:18614:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783967092.138745:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783967092.139163:0:18614:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f571a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783967092.139335:0:18614:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783967092.139342:0:18614:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b31606815c 00010000:00010000:0.0:1783967092.155299:0:18614:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1783967092.156688:0:18614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1783967092.167563:0:18614:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1783967092.169992:0:18614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783967092.170009:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967092.170016:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170018:0:18614:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783967092.170022:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967092.170025:0:18614:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1783967092.170027:0:18614:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967092.170028:0:18614:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967092.170030:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967092.170032:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170033:0:18614:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967092.170036:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967092.170039:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170041:0:18614:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783967092.170043:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783967092.170046:0:18614:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783967092.170048:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967092.170050:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170051:0:18614:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783967092.170053:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967092.170055:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170057:0:18614:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783967092.170060:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783967092.170092:0:18614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967092.170095:0:18614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967092.170096:0:18614:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783967092.170099:0:18614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783967092.170922:0:18597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783967092.171086:0:18597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783967092.171109:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967092.171122:0:18597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967092.171130:0:18597:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f571a000 from 1 10000000:01000000:0.0:1783967092.171133:0:18597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967092.171263:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967092.171298:0:18597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967092.171310:0:18597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967092.171337:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967092.171411:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.171584:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964032 00000100:00100000:2.0:1783967092.171602:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964032 00000100:00100000:2.0:1783967092.171645:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783967092.171653:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+19:18597:x1870624587964032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967092.171667:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967092.171679:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068163 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.171702:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068163 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.171713:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068163 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.171721:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630800, rc 0) 00000100:00100000:0.0:1783967092.171802:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.179229:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964032:12345-0@lo:101:mount.lustre.0 Request processed in 7564us (7806us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.179245:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783967092.184748:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967092.185373:0:18597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.185399:0:18597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783967092.189730:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783967092.190628:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967092.191217:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783967092.191361:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783967092.194085:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783967092.194118:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783967092.194400:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967092.195110:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.195577:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967092.199198:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964160 00000100:00100000:3.0:1783967092.199213:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964160 00000100:00100000:3.0:1783967092.199602:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783967092.199614:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967092.199833:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964160:12345-0@lo:501:mount.lustre.0 Request processed in 221us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.199841:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783967092.199970:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967092.200031:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967092.200094:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.205192:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967092.205408:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964288 00000100:00100000:0.0:1783967092.205421:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964288 00000100:00100000:0.0:1783967092.205677:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783967092.205688:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967092.205878:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964288:12345-0@lo:503:mount.lustre.0 Request processed in 190us (5782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967092.205886:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783967092.206178:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783967092.206645:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783967092.206791:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967092.206840:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.206861:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d9300000 going to sleep for 11 seconds 00000100:00100000:3.0:1783967092.207527:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964416 00000100:00100000:3.0:1783967092.207535:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964416 00000100:00100000:3.0:1783967092.207579:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783967092.207599:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967092.207742:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964416:12345-0@lo:502:mount.lustre.0 Request processed in 155us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.207750:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783967092.208391:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783967092.208854:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783967092.208889:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783967092.208908:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783967092.208947:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783967092.209032:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783967092.209052:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783967092.209064:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783967092.209075:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1783967092.209088:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1783967092.209100:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1783967092.209112:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1783967092.209152:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967092.209209:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.209383:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967092.209504:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964544 00000100:00100000:3.0:1783967092.209511:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964544 00000100:00100000:3.0:1783967092.209549:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783967092.209557:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967092.209892:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964544:12345-0@lo:502:mount.lustre.0 Request processed in 335us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.209900:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783967092.210073:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783967092.210130:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1783967092.210141:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1783967092.216417:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967092.216431:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.216495:0:18618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783967092.216504:0:18618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f571a000 00000020:00000080:2.0:1783967092.216507:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967092.216514:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967092.216517:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.216518:0:18618:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783967092.216521:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967092.216523:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.216524:0:18618:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783967092.216527:0:18618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f571a000 00000020:00000080:2.0:1783967092.216529:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967092.216681:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967092.216685:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.216687:0:18618:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783967092.216690:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967092.216693:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.216694:0:18618:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967092.216697:0:18618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f571a000 00000020:00000080:2.0:1783967092.216699:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967092.218416:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967092.218430:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.218431:0:18618:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783967092.218663:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967092.218669:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.218670:0:18618:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783967092.218675:0:18618:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f571a000 00000020:00000080:2.0:1783967092.218677:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783967092.218751:0:18618:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967092.218755:0:18618:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967092.218756:0:18618:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783967092.218759:0:18618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1783967092.229080:0:18597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783967092.229134:0:18597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783967092.229161:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.229176:0:18597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967092.229708:0:18597:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783967092.229713:0:18597:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05f571a000 10000000:01000000:1.0:1783967092.229716:0:18597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05f571a000 10000000:01000000:1.0:1783967092.229721:0:18597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783967092.229728:0:18597:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f571a000 from 1 10000000:01000000:1.0:1783967092.229732:0:18597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783967092.229807:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.229832:0:18597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.229847:0:18597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967092.229881:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967092.231138:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.231189:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967092.232402:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964672 00000100:00100000:1.0:1783967092.232413:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964672 00000100:00100000:1.0:1783967092.233105:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783967092.233120:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+20:18597:x1870624587964672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967092.233138:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967092.233163:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a04c274e600/0x9269c8b316068178 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068171 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.233197:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a04c274e600/0x9269c8b316068178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068171 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.233209:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a04c274e600/0x9269c8b316068178 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068171 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.233218:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a04c274e600, rc 0) 00000100:00100000:1.0:1783967092.234752:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587964672:12345-0@lo:101:mount.lustre.0 Request processed in 1628us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.234763:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783967092.234872:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967092.236380:0:18597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.236401:0:18597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783967092.244402:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1783967092.246713:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967092.249192:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1783967092.249253:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1783967092.249751:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1783967092.249805:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1783967092.249822:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1783967092.249836:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1783967092.249849:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1783967092.249862:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1783967092.249875:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1783967092.249899:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1783967092.249918:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1783967092.249945:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1783967092.251368:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1783967092.251429:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1783967092.251604:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1783967092.251621:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1783967092.251632:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1783967092.251642:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1783967092.251652:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1783967092.252726:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1783967092.252807:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1783967092.252822:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1783967092.252837:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1783967092.252866:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1783967092.252880:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1783967092.252906:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1783967092.252924:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1783967092.252950:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1783967092.255080:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1783967092.255129:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1783967092.255157:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1783967092.255169:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1783967092.255183:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1783967092.255196:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1783967092.255209:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1783967092.255223:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1783967092.255250:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1783967092.255289:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1783967092.255295:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1783967092.255410:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967092.256740:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.257321:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.258090:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964800 00000100:00100000:2.0:1783967092.258112:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964800 00000100:00100000:2.0:1783967092.258186:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783967092.258196:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587964800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967092.259251:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587964800:12345-0@lo:501:mount.lustre.0 Request processed in 1051us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.259263:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783967092.260811:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967092.260891:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967092.260984:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967092.261042:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.261188:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587964928 00000100:00100000:2.0:1783967092.261196:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587964928 00000100:00100000:2.0:1783967092.261256:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783967092.261274:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587964928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967092.261389:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587964928:12345-0@lo:503:mount.lustre.0 Request processed in 117us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.261398:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783967092.261913:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587964928:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783967092.262403:0:18597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967092.262527:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967092.262585:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967092.262634:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.267394:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965056 00000100:00100000:2.0:1783967092.267409:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965056 00000100:00100000:2.0:1783967092.267482:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783967092.267492:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967092.267675:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965056:12345-0@lo:502:mount.lustre.0 Request processed in 184us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.267684:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783967092.269167:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967092.269480:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783967092.269532:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783967092.269548:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783967092.269561:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783967092.269573:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783967092.269584:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783967092.269596:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783967092.269609:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783967092.269621:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783967092.269633:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783967092.269647:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783967092.269660:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783967092.269674:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783967092.269688:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783967092.269702:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783967092.269714:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783967092.269728:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783967092.269755:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783967092.269793:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783967092.269810:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783967092.269824:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783967092.269836:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783967092.269849:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783967092.269862:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783967092.269874:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1783967092.270052:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1783967092.270075:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1783967092.270091:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1783967092.270106:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1783967092.270124:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1783967092.270149:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1783967092.270164:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1783967092.270178:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1783967092.270208:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1783967092.270224:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1783967092.270239:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1783967092.270253:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1783967092.270266:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1783967092.270279:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1783967092.270291:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1783967092.270304:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1783967092.270318:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1783967092.270331:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1783967092.270344:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1783967092.270357:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1783967092.270369:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1783967092.270384:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1783967092.270397:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1783967092.270462:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967092.270535:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967092.270580:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967092.270971:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965184 00000100:00100000:2.0:1783967092.270980:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965184 00000100:00100000:2.0:1783967092.271036:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783967092.271045:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967092.271169:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965184:12345-0@lo:502:mount.lustre.0 Request processed in 124us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.271186:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783967092.271496:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967092.271692:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1783967092.271718:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1783967092.271745:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967092.271800:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967092.271830:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965312 00000100:00100000:0.0:1783967092.271834:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965312 00000100:00100000:0.0:1783967092.271859:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783967092.271865:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967092.273237:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967092.273534:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587965312:12345-0@lo:502:mount.lustre.0 Request processed in 1663us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967092.273544:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783967092.274058:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587965312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967092.274158:0:18597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1783967092.274171:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00010000:00010000:1.0:1783967092.281642:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783967092.281846:0:18623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783967092.281862:0:18623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a05c34c8000) 00000020:00000080:0.0:1783967092.282134:0:18623:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1783967092.282340:0:18623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f571a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783967092.282345:0:18623:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f571a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783967092.282348:0:18623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f571a000 3 00010000:00080000:0.0:1783967092.282389:0:18623:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05c37c1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967092.287650:0:18623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1783967092.287809:0:18623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783967092.287864:0:18623:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783967092.287879:0:18623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9269c8b316068186 00000100:00080000:0.0:1783967092.287902:0:18623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967092.287909:0:18623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a05c37c1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967092.288162:0:18623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3b100 x1870624587965440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967092.288195:0:18623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783967092.288321:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587965440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967092.288405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967092.288579:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965440 00000100:00100000:1.0:1783967092.288588:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965440 00000100:00100000:1.0:1783967092.288620:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967092.288627:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587965440:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783967092.288654:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1783967092.288684:0:17097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9269c8b31606818d 00000004:00100000:1.0:1783967092.288699:0:17097:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783967092.288737:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05c9de8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967092.288812:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870624587965440:12345-0@lo:38:llog_process_th.0 Request processed in 182us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.288819:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783967092.288856:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3e3b100 x1870624587965440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967092.288866:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783967092.288874:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783967092.288880:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783967092.289174:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783967092.289178:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783967092.289186:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624587965440:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783967092.289329:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.289334:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.289337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.289346:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.289372:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.289375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.289377:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.289379:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967092.289406:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587965952:0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.289463:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967092.289468:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587965568:0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.289521:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587965696:0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.289555:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967092.289559:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587965824:0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.289614:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965952 00000100:00100000:3.0:1783967092.289619:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965952 00000100:00100000:3.0:1783967092.289647:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965696 00000100:00100000:3.0:1783967092.289650:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965696 00000100:00100000:3.0:1783967092.289681:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967092.289689:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289731:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587965952:12345-0@lo:400:kworker.0 Request processed in 43us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.289738:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967092.289752:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967092.289765:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587965696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289815:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587965696:12345-0@lo:400:kworker.0 Request processed in 51us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.289821:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967092.289842:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965568 00000100:00100000:3.0:1783967092.289844:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965568 00000100:00100000:3.0:1783967092.289859:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587965824 00000100:00100000:3.0:1783967092.289861:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587965824 00000100:00100000:3.0:1783967092.289872:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967092.289877:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587965568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.289946:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587965568:12345-0@lo:400:kworker.0 Request processed in 68us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.289952:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967092.290143:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783967092.290152:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587965824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.290197:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587965824:12345-0@lo:400:kworker.0 Request processed in 46us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.290204:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783967092.290242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587965568:0@lo:400:kworker.0 00010000:00080000:3.0:1783967092.290254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ddc00 x1870624587965952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967092.290386:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587965952:0@lo:400:kworker.0 00000100:00100000:3.0:1783967092.290415:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587965824:0@lo:400:kworker.0 00010000:00080000:3.0:1783967092.290424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dca80 x1870624587965696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967092.290445:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587965696:0@lo:400:kworker.0 00000020:01000004:1.0:1783967092.290760:0:18623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783967092.290808:0:18623:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a04c3144d40) 00000020:00000080:1.0:1783967092.290831:0:18623:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1783967092.291173:0:18623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f571a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783967092.291177:0:18623:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f571a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783967092.291180:0:18623:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f571a000 3 00010000:00080000:1.0:1783967092.291213:0:18623:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f4ebd000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967092.297884:0:18623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1783967092.298160:0:18623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1783967092.298210:0:18623:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783967092.298225:0:18623:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9269c8b31606819b 00000100:00080000:0.0:1783967092.298236:0:18623:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967092.298243:0:18623:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a05f4ebd000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967092.298859:0:18623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3e3b100 x1870624587966080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967092.299119:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587966080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967092.299197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967092.299355:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966080 00000100:00100000:3.0:1783967092.299364:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966080 00000100:00100000:3.0:1783967092.299407:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967092.299416:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870624587966080:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783967092.299444:0:17096:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1783967092.299476:0:17096:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9269c8b3160681a2 00000004:00100000:3.0:1783967092.299490:0:17096:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783967092.299522:0:17096:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783967092.299583:0:18623:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1783967092.301358:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:3.0:1783967092.301702:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870624587966080:12345-0@lo:38:llog_process_th.0 Request processed in 2282us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967092.301717:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783967092.301763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.301796:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.301800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.301802:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.301807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.301810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967092.301813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967092.301815:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1783967092.305075:0:18597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783967092.305125:0:18597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783967092.305146:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.305159:0:18597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783967092.305213:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783967092.305216:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967092.305217:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967092.305218:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967092.305220:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967092.305221:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967092.305222:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967092.305224:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967092.305225:0:18597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967092.305230:0:18597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783967092.305232:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967092.305233:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967092.305234:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967092.305235:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967092.305236:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967092.305237:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967092.305238:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967092.305239:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967092.305240:0:18597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967092.305271:0:18597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783967092.305300:0:18597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587966208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967092.305381:0:18597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.305422:0:18597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d176de40 going to sleep for 11 seconds 00000100:00100000:0.0:1783967092.305666:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966208 00000100:00100000:0.0:1783967092.305675:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966208 00000100:00100000:0.0:1783967092.305730:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783967092.305740:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587966208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783967092.305783:0:17090:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783967092.305798:0:17090:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783967092.306159:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3e3b100 x1870624587966080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967092.306171:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783967092.306180:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783967092.306187:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783967092.306201:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783967092.306205:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4ebd000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783967092.306213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624587966080:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1783967092.321145:0:17090:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783967092.321211:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783967092.322436:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:18597:x1870624587966208:12345-0@lo:253:mount.lustre.0 Request processed in 16690us (17047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.322452:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783967092.322634:0:18597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:18597:1870624587966208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967092.322651:0:18597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783967092.322654:0:18597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967092.322656:0:18597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783967092.322657:0:18597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967092.322658:0:18597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967092.322659:0:18597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967092.322660:0:18597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967092.322661:0:18597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967092.322663:0:18597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967092.322664:0:18597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783967092.322679:0:18597:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783967092.324010:0:17111:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783967092.324018:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783967092.325166:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325191:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325200:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160680fa expref: 20 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325208:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325259:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 20 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325344:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 20 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967092.325360:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587966336:0@lo:104: 00000100:00100000:2.0:1783967092.325430:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783967092.325494:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.325503:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967092.325528:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587966464:0@lo:104: 00000100:00100000:2.0:1783967092.325556:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.325581:0:17111:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d176d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967092.326732:0:17080:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783967092.326757:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966336 00000100:00100000:1.0:1783967092.326764:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966336 00000100:00100000:1.0:1783967092.326831:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966464 00000100:00100000:1.0:1783967092.326835:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966464 00000100:00100000:1.0:1783967092.326850:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967092.326858:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587966336:12345-0@lo:104: 00010000:00010000:1.0:1783967092.326872:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327095:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783967092.327102:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587966336:12345-0@lo:104: Request processed in 245us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.327109:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967092.327129:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967092.327135:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587966464:12345-0@lo:104: 00010000:00010000:1.0:1783967092.327144:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327179:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783967092.327185:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587966464:12345-0@lo:104: Request processed in 51us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967092.327191:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783967092.327245:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967092.327252:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327259:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967092.327340:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327349:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967092.327356:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967092.327362:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783967092.327407:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327413:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967092.327437:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327445:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b3160680fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068101 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327458:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967092.327461:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327466:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967092.327469:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327482:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967092.327487:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967092.327492:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783967092.327506:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327511:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967092.327530:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327537:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1000/0x9269c8b3160680ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160680f3 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967092.327550:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967092.327551:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967092.327553:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967092.327560:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967092.327572:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587966592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967092.328060:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587966336:0@lo:104: 00000100:00100000:2.0:1783967092.328073:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587966464:0@lo:104: 00010000:00010000:2.0:1783967092.328099:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967092.328724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.328872:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966592 00000100:00100000:2.0:1783967092.328880:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966592 00010000:00010000:2.0:1783967092.330110:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 21 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967092.330200:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967092.330211:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+21:3646:x1870624587966592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967092.330228:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967092.330234:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 21 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.330246:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 21 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.331074:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068101 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160680fa expref: 21 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.331098:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967092.331175:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+20:3646:x1870624587966592:12345-0@lo:103:ldlm_bl.0 Request processed in 967us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.331200:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783967092.331659:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587966720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967092.331711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967092.333541:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966720 00000100:00100000:2.0:1783967092.333553:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966720 00010000:00010000:2.0:1783967092.333647:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967092.333675:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967092.333684:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+20:3647:x1870624587966720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967092.333698:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967092.333703:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333714:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333732:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630000/0x9269c8b3160680f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160680ec expref: 20 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333748:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333758:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783967092.333792:0:17081:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036591042s 00010000:00010000:2.0:1783967092.333798:0:17081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333805:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333827:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333835:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333843:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967092.333848:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333857:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333875:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.333900:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967092.334149:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+19:3647:x1870624587966720:12345-0@lo:103:ldlm_bl.0 Request processed in 465us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967092.334158:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967092.334246:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587966592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967092.334406:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587966720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967092.334427:0:17111:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.334436:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967092.334454:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631c00/0x9269c8b3160681a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1783967092.336598:0:18597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783967092.341096:0:18597:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783967092.341107:0:18597:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783967092.341142:0:18597:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783967092.342080:0:18597:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783967092.342114:0:18597:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783967092.342150:0:18597:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1783967092.343000:0:18597:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783967092.346326:0:18597:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967093.303012:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783967093.368944:0:18676:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967093.369567:0:18676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1783967093.566058:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967093.566070:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c2f6c000 from 9 10000000:01000000:0.0:1783967093.566077:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967093.566143:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967093.566157:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967093.566169:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967093.566196:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587966848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967093.566271:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967093.566321:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967093.566623:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966848 00000100:00100000:2.0:1783967093.566630:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966848 00000100:00100000:2.0:1783967093.566700:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783967093.566712:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+19:17093:x1870624587966848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967093.566726:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967093.566741:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160681b0 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.566766:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.566798:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 20 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.566808:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783967093.566855:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+20:17093:x1870624587966848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967093.566873:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783967093.566939:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587966848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967093.566958:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.566967:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967093.567022:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587966976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783967093.567054:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967093.567076:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967093.567133:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587966976 00000100:00100000:2.0:1783967093.567138:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587966976 00000100:00100000:2.0:1783967093.567162:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783967093.567169:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:17093:x1870624587966976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783967093.567182:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783967093.567198:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783967093.567201:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783967093.567278:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:17093:x1870624587966976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967093.567286:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783967093.567316:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587966976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783967093.567376:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783967093.567385:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567402:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967093.567410:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783967093.567413:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05fcff7800 from 9 10000000:01000000:2.0:1783967093.567415:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783967093.567431:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567439:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567447:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967093.567459:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587967104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783967093.567484:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967093.567497:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967093.567508:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967104 00000100:00100000:2.0:1783967093.567511:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967104 00000100:00100000:2.0:1783967093.567532:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783967093.567538:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:17093:x1870624587967104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967093.567545:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967093.567554:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160681be expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567568:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160681be expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567587:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160681be expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567594:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783967093.567622:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587967104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967093.567629:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783967093.567660:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587967104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967093.567670:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.567677:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967093.567711:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587967232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783967093.567739:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967093.567752:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967093.567762:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967232 00000100:00100000:2.0:1783967093.567766:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967232 00000100:00100000:2.0:1783967093.567812:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783967093.567819:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587967232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783967093.567829:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783967093.567840:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783967093.567844:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1783967093.567916:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587967232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967093.567932:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783967093.567962:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587967232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783967093.567999:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783967093.568005:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967093.568013:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967094.329014:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967095.160553:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587967488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967095.160640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967095.161347:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967095.161366:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587967360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967095.161402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967095.162043:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967488 00000100:00100000:0.0:1783967095.162055:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967488 00000100:00100000:0.0:1783967095.162093:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967360 00000100:00100000:0.0:1783967095.162096:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967360 00000100:00100000:0.0:1783967095.162114:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967095.162151:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587967488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967095.162193:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783967095.162450:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587967488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 303us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967095.162458:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967095.162490:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967095.162497:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587967360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967095.162515:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967095.162693:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587967360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967095.162699:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783967095.163094:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587967360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967095.163391:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587967488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783967095.352841:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967096.055460:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783967096.375090:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967097.399419:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967097.729713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967097.729720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967097.729723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967097.729725:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967097.729742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967097.729745:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967097.729747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967097.729750:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967097.729815:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587968000:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.729904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.729966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783967097.729973:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587967616:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730028:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587968128:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730076:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587967872:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730111:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587968384:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730145:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783967097.730167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587967744:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730200:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587968256:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967097.730258:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968128 00000100:00100000:1.0:1783967097.730264:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968128 00000100:00100000:1.0:1783967097.730300:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967872 00000100:00100000:1.0:1783967097.730303:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967872 00000100:00100000:1.0:1783967097.730315:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968384 00000100:00100000:1.0:1783967097.730317:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968384 00000100:00100000:1.0:1783967097.730340:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968256 00000100:00100000:1.0:1783967097.730343:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968256 00000100:00100000:1.0:1783967097.730359:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967097.730366:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587968128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730417:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587968128:12345-0@lo:400:kworker.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730424:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967097.730440:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967097.730446:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587967872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730475:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587967872:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730481:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967097.730495:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783967097.730501:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587968384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730525:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587968384:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730530:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783967097.730541:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783967097.730546:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587968256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730568:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587968256:12345-0@lo:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730580:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783967097.730605:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968000 00000100:00100000:1.0:1783967097.730609:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968000 00000100:00100000:1.0:1783967097.730625:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967744 00000100:00100000:1.0:1783967097.730627:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967744 00000100:00100000:1.0:1783967097.730637:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967097.730642:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587968000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730672:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587968000:12345-0@lo:400:kworker.0 Request processed in 30us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730678:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967097.730689:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783967097.730694:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587967744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730718:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587967744:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967097.730724:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783967097.730754:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587967744:0@lo:400:kworker.0 00010000:00080000:1.0:1783967097.730766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e13800 x1870624587968256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967097.730798:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587968256:0@lo:400:kworker.0 00010000:00080000:1.0:1783967097.730809:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e10a80 x1870624587967872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967097.730817:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587967872:0@lo:400:kworker.0 00010000:00080000:1.0:1783967097.730835:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e10700 x1870624587968384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967097.730857:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587968384:0@lo:400:kworker.0 00010000:00080000:1.0:1783967097.730896:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e11880 x1870624587968128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967097.730903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587968128:0@lo:400:kworker.0 00000100:00100000:1.0:1783967097.730911:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587968000:0@lo:400:kworker.0 00000100:00080000:0.0:1783967097.733486:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967097.733498:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967097.733533:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587967616 00000100:00100000:0.0:1783967097.733545:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587967616 00000100:00100000:0.0:1783967097.733611:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783967097.733623:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:3645:x1870624587967616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967097.733714:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:3645:x1870624587967616:12345-0@lo:400:kworker.0 Request processed in 94us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967097.733721:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783967097.734947:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587967616:0@lo:400:kworker.0 00010000:00010000:2.0:1783967098.425710:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967098.743565:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1783967098.875517:0:18966:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783967099.452467:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967099.512933:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967084/real 1783967084] req@ffff9a05d8acbb80 x1870624587961216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.513285:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05d8acbb80 x1870624587961216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.513297:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967084/real 1783967084] req@ffff9a04c372a300 x1870624587961344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967099 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.513309:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c372a300 x1870624587961344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967099 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783967099.513333:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967099.513349:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967099.513354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587961216:0@lo:8:kworker.0 00000100:00080000:3.0:1783967099.513531:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.513536:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967099.513539:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.513542:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967099.513568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.513572:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783967099.513575:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967099.513580:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1783967099.513585:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783967099.513591:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05ee18b000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967099.513612:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ded80 x1870624587969024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967099.513636:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.513640:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967099.513682:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587968640:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.513746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967099.513813:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587969280:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.513845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967099.513882:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783967099.513888:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587968512:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.513917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967099.514080:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587968768:0@lo:400:kworker.0 00000100:00100000:0.0:1783967099.514115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967099.514137:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587969408:0@lo:400:kworker.0 00000100:00100000:0.0:1783967099.514162:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783967099.514472:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967099.514487:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967099.514491:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587961344:0@lo:8:kworker.0 00000100:00100000:1.0:1783967099.514519:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587969024:0@lo:8:kworker.0 00000100:00100000:1.0:1783967099.514561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967099.514651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967099.514658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587968896:0@lo:400:kworker.0 00000100:00100000:0.0:1783967099.514689:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967099.514724:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969024 00000100:00100000:0.0:1783967099.514731:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969024 00000100:00100000:0.0:1783967099.514766:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967099.514802:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624587969024:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783967099.514836:0:18601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1783967099.514864:0:18601:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b3160681cc 00002000:00100000:0.0:1783967099.514880:0:18601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c3f06000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783967099.514885:0:18601:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783967099.514888:0:18601:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783967099.516337:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969280 00000100:00100000:1.0:1783967099.516351:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969280 00000100:00100000:1.0:1783967099.516430:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968768 00000100:00100000:1.0:1783967099.516434:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968768 00000100:00100000:1.0:1783967099.516449:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969408 00000100:00100000:1.0:1783967099.516452:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969408 00000100:00100000:1.0:1783967099.516471:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783967099.516481:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587969280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967099.516581:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587969280:12345-0@lo:400:kworker.0 Request processed in 101us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967099.516589:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783967099.516606:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783967099.516611:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587968768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967099.516649:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587968768:12345-0@lo:400:kworker.0 Request processed in 37us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967099.516655:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783967099.516667:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783967099.516673:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587969408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967099.516701:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587969408:12345-0@lo:400:kworker.0 Request processed in 28us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967099.516707:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783967099.516815:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ddc00 x1870624587968768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.516832:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587968768:0@lo:400:kworker.0 00010000:00080000:1.0:1783967099.516845:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2df480 x1870624587969408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.516872:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587969408:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.517409:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587969152:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.517460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783967099.517497:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dce00 x1870624587969280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967099.517507:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587969280:0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.517545:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968640 00000100:00100000:3.0:1783967099.517551:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968640 00000100:00100000:3.0:1783967099.517579:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968896 00000100:00100000:3.0:1783967099.517582:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968896 00000100:00100000:3.0:1783967099.517598:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967099.517605:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587968640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.517650:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587968640:12345-0@lo:400:kworker.0 Request processed in 45us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.517656:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967099.517670:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967099.517686:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587968896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967099.517722:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587968896:12345-0@lo:400:kworker.0 Request processed in 37us (3031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.517727:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967099.517750:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969152 00000100:00100000:3.0:1783967099.517754:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969152 00000100:00100000:3.0:1783967099.517820:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00002000:00080000:0.0:1783967099.517828:0:18601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:3.0:1783967099.517829:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587969152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783967099.517866:0:18601:0:(import.c:65:import_set_state_nolock()) ffff9a04c3f02000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967099.517867:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587969152:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.517876:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783967099.517899:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587968512 00000100:00100000:3.0:1783967099.517904:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587968512 00000100:00100000:0.0:1783967099.517919:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587969024:12345-0@lo:8:kworker.0 Request processed in 3126us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967099.517930:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967099.517938:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783967099.517961:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:3646:x1870624587968512:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783967099.517961:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967099.517967:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967099.518000:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:3646:x1870624587968512:12345-0@lo:400:kworker.0 Request processed in 55us (4082us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.518007:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1783967099.518045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.518050:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967099.521972:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587968896:0@lo:400:kworker.0 00010000:00080000:1.0:1783967099.522029:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ded80 x1870624587969024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.522040:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783967099.522061:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1783967099.522071:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783967099.522078:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783967099.522082:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783967099.522095:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783967099.522101:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587969024:0@lo:8:kworker.0 00000004:00080000:1.0:1783967099.522159:0:17838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783967099.522179:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587969664:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1783967099.522237:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967099.522260:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97300 going to sleep for 11 seconds 00000100:00100000:1.0:1783967099.522271:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587969536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967099.522293:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783967099.522564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.522571:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967099.522574:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967099.522578:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967099.522580:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967099.522599:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:3.0:1783967099.522603:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783967099.522610:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000004:00080000:0.0:1783967099.522642:0:17837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783967099.522687:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3fd0000 x1870624587969792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1783967099.522752:0:17837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 575723981159ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783967099.522760:0:17837:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783967099.522830:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587968512:0@lo:400:kworker.0 00010000:00080000:0.0:1783967099.522847:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2de300 x1870624587969152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967099.522857:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587969152:0@lo:400:kworker.0 00000100:00100000:0.0:1783967099.522869:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587968640:0@lo:400:kworker.0 00000100:00100000:1.0:1783967099.524497:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587969792:0@lo:8:kworker.0 00000100:00100000:1.0:1783967099.524568:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967099.525348:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969664 00000100:00100000:0.0:1783967099.525365:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969664 00000100:00100000:2.0:1783967099.525573:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969792 00000100:00100000:2.0:1783967099.525578:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969792 00000100:00100000:2.0:1783967099.525614:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967099.525623:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587969792:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783967099.525646:0:18604:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783967099.527354:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969536 00000100:00100000:3.0:1783967099.527378:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969536 00000100:00100000:3.0:1783967099.527428:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967099.527437:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870624587969536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783967099.527476:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783967099.527576:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1870624587969536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (5281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.527584:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783967099.527641:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2680e00 x1870624587969536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967099.527667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587969536:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783967099.531645:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783967099.533186:0:17829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783967099.565677:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587969792:12345-0@lo:8:kworker.0 Request processed in 40043us (41097us total) trans 0 rc -19/-19 00000100:00080000:1.0:1783967099.565693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967099.565701:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783967099.565705:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967099.565709:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587969792:0@lo:8:kworker.0 00000100:00100000:2.0:1783967099.565745:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967099.565760:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1870624587969664:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:3.0:1783967099.574756:0:18604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1783967099.574810:0:18604:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1783967099.574923:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1870624587969664:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9161us (52678us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967099.574947:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783967099.575152:0:17838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2683b80 x1870624587969664/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783967115 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.575169:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587969664:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783967099.575185:0:17838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783967099.575229:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587969920:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783967099.575270:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967099.575310:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967099.575351:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587969920 00000100:00100000:2.0:1783967099.575360:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587969920 00000100:00100000:2.0:1783967099.575433:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967099.575445:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17838:x1870624587969920:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1783967099.575472:0:18601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1783967099.575522:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17838:x1870624587969920:12345-0@lo:5:osp-pre-0-1.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967099.575529:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783967099.575576:0:17838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2683b80 x1870624587969920/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967115 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.575587:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587969920:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783967099.575595:0:17838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1783967099.575618:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587970048:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783967099.575643:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967099.577689:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967099.579235:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970048 00000100:00100000:2.0:1783967099.579249:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970048 00000100:00100000:1.0:1783967099.580036:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967099.580066:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17838:x1870624587970048:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1783967099.580119:0:18604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1783967099.629809:0:18598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1783967099.629827:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1783967099.630196:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17838:x1870624587970048:12345-0@lo:5:osp-pre-0-1.0 Request processed in 50127us (54545us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783967099.630207:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783967099.630657:0:17838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2683b80 x1870624587970048/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967115 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967099.630670:0:17838:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783967099.630677:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17838:1870624587970048:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783967099.630713:0:17838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1783967099.630810:0:17838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17838:1870624587970176:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783967099.630855:0:17838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967099.630889:0:17838:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce97300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967099.631016:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970176 00000100:00100000:2.0:1783967099.631024:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970176 00000100:00100000:2.0:1783967099.631209:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967099.631220:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17838:x1870624587970176:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783967099.631286:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17838:x1870624587970176:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967099.631294:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783967099.631364:0:17838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2683b80 x1870624587970176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967115 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967099.631375:0:17838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17838:1870624587970176:0@lo:900:osp-pre-0-1.0 00000020:00000004:1.0:1783967100.202154:0:19018:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967100.202444:0:19018:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783967100.280704:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587970304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967100.280797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967100.281568:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587970432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967100.281603:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967100.281752:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970304 00000100:00100000:3.0:1783967100.281796:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970304 00000100:00100000:0.0:1783967100.281820:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970432 00000100:00100000:0.0:1783967100.281824:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970432 00000100:00100000:0.0:1783967100.281846:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783967100.281854:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587970304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967100.281904:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967100.281948:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587970304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967100.282074:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587970304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967100.288079:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783967100.288888:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783967100.288912:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587970432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967100.288961:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967100.289056:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587970432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (7451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967100.289063:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783967100.289286:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587970432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783967100.476574:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783967101.314417:0:19068:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967101.314863:0:19068:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783967101.501952:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967102.523127:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967102.588943:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967082/real 1783967082] req@ffff9a04c3e3aa00 x1870624587959552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967102.588972:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c3e3aa00 x1870624587959552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967102.588982:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967082/real 1783967082] req@ffff9a04c3e39f80 x1870624587959680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967102.589003:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c3e39f80 x1870624587959680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967102.589023:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967102.589043:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783967102.589048:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587959552:0@lo:8:kworker.0 00000100:00080000:0.0:1783967102.589053:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967102.589057:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783967102.589060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587959680:0@lo:8:kworker.0 00000100:00080000:1.0:1783967102.589193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967102.589197:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783967102.589200:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967102.589205:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:1.0:1783967102.589209:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783967102.589220:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a05f1ac5000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967102.589238:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c2680e00 x1870624587970816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967102.589248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967102.589251:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967102.589253:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967102.589255:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:1.0:1783967102.589258:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783967102.589269:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967102.589279:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddf80 x1870624587970944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967102.589307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967102.589311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967102.589312:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967102.589315:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1783967102.589318:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783967102.589321:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967102.589329:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dea00 x1870624587971456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967102.589372:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587970688:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589474:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587971584:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783967102.589522:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587970560:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589549:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589568:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587971328:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589617:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587971072:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589638:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589653:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587971712:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589686:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783967102.589691:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587971200:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589726:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587971840:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967102.589799:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970688 00000100:00100000:1.0:1783967102.589806:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970688 00000100:00100000:1.0:1783967102.589839:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971200 00000100:00100000:1.0:1783967102.589841:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971200 00000100:00100000:1.0:1783967102.589856:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967102.589863:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589913:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587970688:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.589920:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967102.589935:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783967102.589941:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587971200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.589973:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587971200:12345-0@lo:400:kworker.0 Request processed in 32us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.589988:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783967102.590008:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971584 00000100:00100000:1.0:1783967102.590013:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971584 00000100:00100000:1.0:1783967102.590030:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971072 00000100:00100000:1.0:1783967102.590032:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971072 00000100:00100000:1.0:1783967102.590040:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971712 00000100:00100000:1.0:1783967102.590042:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971712 00000100:00100000:1.0:1783967102.590064:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971840 00000100:00100000:1.0:1783967102.590067:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971840 00000100:00100000:1.0:1783967102.590086:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783967102.590092:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587971584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590124:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587971584:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590129:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783967102.590140:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783967102.590146:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587971072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590172:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587971072:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590177:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783967102.590187:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967102.590193:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587971712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590216:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587971712:12345-0@lo:400:kworker.0 Request processed in 23us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590221:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967102.590231:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967102.590235:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587971840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590268:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587971840:12345-0@lo:400:kworker.0 Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590274:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967102.590294:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970560 00000100:00100000:1.0:1783967102.590298:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970560 00000100:00100000:1.0:1783967102.590322:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783967102.590328:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:3648:x1870624587970560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590354:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:3648:x1870624587970560:12345-0@lo:400:kworker.0 Request processed in 27us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590360:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783967102.590386:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971328 00000100:00100000:1.0:1783967102.590390:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971328 00000100:00100000:1.0:1783967102.590419:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783967102.590427:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587971328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590459:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587971328:12345-0@lo:400:kworker.0 Request processed in 34us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967102.590465:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783967102.590492:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783967102.590497:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783967102.590499:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967102.590528:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587971200:0@lo:400:kworker.0 00010000:00080000:1.0:1783967102.590539:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ddc00 x1870624587971840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967102.590547:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587971840:0@lo:400:kworker.0 00010000:00080000:1.0:1783967102.590555:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2de300 x1870624587971072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967102.590574:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587971072:0@lo:400:kworker.0 00010000:00080000:1.0:1783967102.590586:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2df480 x1870624587971712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967102.590594:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587971712:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590625:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587970560:0@lo:400:kworker.0 00010000:00080000:1.0:1783967102.590635:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ded80 x1870624587971328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967102.590642:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587971328:0@lo:400:kworker.0 00000100:00100000:1.0:1783967102.590652:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587970688:0@lo:400:kworker.0 00010000:00080000:1.0:1783967102.590661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dce00 x1870624587971584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967102.590668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587971584:0@lo:400:kworker.0 00000100:00100000:0.0:1783967102.591003:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587970816:0@lo:8:kworker.0 00000100:00100000:0.0:1783967102.591040:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967102.591075:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587970944:0@lo:8:kworker.0 00000100:00100000:0.0:1783967102.591097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967102.591115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587971456:0@lo:8:kworker.0 00000100:00100000:0.0:1783967102.591137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967102.591170:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970816 00000100:00100000:0.0:1783967102.591174:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970816 00000100:00100000:0.0:1783967102.591191:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587970944 00000100:00100000:0.0:1783967102.591193:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587970944 00000100:00100000:0.0:1783967102.591199:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971456 00000100:00100000:0.0:1783967102.591202:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971456 00000100:00100000:0.0:1783967102.591211:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967102.591216:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624587970816:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783967102.591240:0:18603:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:0.0:1783967102.591281:0:18603:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b3160681d3 00002000:00100000:0.0:1783967102.591295:0:18603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a04c3f03800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783967102.591299:0:18603:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783967102.591301:0:18603:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783967102.591530:0:18603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783967102.591554:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9a04c3f05800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967102.591598:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587970816:12345-0@lo:8:kworker.0 Request processed in 381us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967102.591605:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967102.591620:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967102.591625:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624587970944:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783967102.591650:0:18603:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967102.591691:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624587970944:12345-0@lo:8:kworker.0 Request processed in 64us (592us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967102.591697:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967102.591709:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967102.591714:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624587971456:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783967102.591724:0:18603:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967102.591756:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624587971456:12345-0@lo:8:kworker.0 Request processed in 41us (618us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967102.591762:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783967102.591822:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2680e00 x1870624587970816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967102.591830:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783967102.591837:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783967102.591844:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783967102.591848:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783967102.591851:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783967102.591865:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783967102.591870:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587970816:0@lo:8:kworker.0 00000100:00080000:0.0:1783967102.591881:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967102.591885:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967102.591887:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587970944:0@lo:8:kworker.0 00000100:00080000:0.0:1783967102.591894:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967102.591896:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967102.591906:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587971456:0@lo:8:kworker.0 00000004:00080000:0.0:1783967102.591965:0:17120:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1783967102.592439:0:17120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17120:1870624587972096:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783967102.592479:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967102.592558:0:17120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967102.592577:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587971968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967102.592607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967102.592645:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587971968 00000100:00100000:0.0:1783967102.592650:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587971968 00000100:00100000:0.0:1783967102.592694:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967102.592702:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587971968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783967102.592724:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783967102.592791:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587971968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967102.592798:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783967102.592819:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783967102.592841:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3e3b100 x1870624587971968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967102.592856:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587971968:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1783967102.593016:0:17119:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783967102.593105:0:17119:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 578794334395ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783967102.593113:0:17119:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783967102.596087:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972096 00000100:00100000:3.0:1783967102.596103:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972096 00000100:00100000:3.0:1783967102.596162:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967102.596173:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17120:x1870624587972096:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783967102.604695:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1783967102.614539:0:18603:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783967102.614852:0:18603:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1783967102.614862:0:18603:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1783967102.636835:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.636851:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.636893:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.636898:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.636906:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.636926:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.636938:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.636946:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.636966:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.637006:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.637015:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.637026:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.637031:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.637041:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.637076:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.637084:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b3160681da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.637102:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.637104:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.637107:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967102.639297:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967102.639310:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.639329:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1783967102.639334:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967102.639341:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.639357:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.639368:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.639377:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.639411:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967102.640067:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967102.640076:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.640085:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967102.640090:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.640099:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.640129:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.640137:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87c03b7/0x9269c8b3160681e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.640155:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.640157:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.640159:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967102.640167:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967102.640173:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640183:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1783967102.640187:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967102.640191:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640202:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640210:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640218:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640252:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783967102.640789:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967102.640798:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640808:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1783967102.640812:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967102.640817:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640839:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640848:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640855:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.640876:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783967102.640908:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967102.640916:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.640926:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.640931:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.640939:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.640953:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.640961:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ec89e03/0x9269c8b3160681e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.640991:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.640995:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641002:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.641006:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641012:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641023:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641029:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da01ed17/0x9269c8b3160681ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641040:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.641042:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.641043:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967102.641206:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967102.641211:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.641220:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1783967102.641222:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967102.641226:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.641235:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.641258:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.641277:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.641299:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.641346:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.641352:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641360:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.641370:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641378:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641390:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641396:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000036b0a01/0x9269c8b3160681f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.641428:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.641430:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.641432:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.642045:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967102.642579:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967102.642767:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.642862:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1783967102.642867:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967102.642874:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.642887:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.642896:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.642904:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.643303:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783967102.648094:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.648109:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.648125:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.648130:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.648137:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.648152:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.648161:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.648180:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.648250:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967102.648258:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.648275:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.648279:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.648288:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.648304:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.648311:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa6affbf/0x9269c8b3160681fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.648521:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.648528:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.648536:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.648545:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.648549:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.648558:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.648572:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.648589:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068204 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.648608:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.648610:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.649121:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.649128:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.649138:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.649142:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.649147:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.649157:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.649166:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.649174:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.649820:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967102.649828:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.649837:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.649842:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.649852:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.649867:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.649887:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.649888:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.649891:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.655063:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.655091:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783967102.655102:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606820b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783967102.655985:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.655994:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656009:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.656014:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.656022:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656036:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656046:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656055:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.656132:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967102.656140:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.656149:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.656153:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.656162:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.656180:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.656190:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.656192:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.656193:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.656345:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783967102.656350:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc1b4e55/0x9269c8b316068212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783967102.656940:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.656948:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656969:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.656973:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.656979:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.656990:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.657000:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.657007:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.657059:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967102.657065:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.657074:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.657077:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.657094:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.657106:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.657164:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783967102.657169:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.657238:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.657306:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.657308:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.657310:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.666120:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.666134:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666150:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.666155:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.666161:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666189:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666200:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666208:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666234:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783967102.666899:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.666909:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666923:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.666927:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.666932:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666943:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666951:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666970:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.666985:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783967102.667279:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967102.667287:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667306:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967102.667311:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667321:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667339:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667346:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006194fa10/0x9269c8b316068220 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667364:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967102.667368:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667374:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967102.667377:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667384:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667402:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667414:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.667425:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967102.667427:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967102.667429:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.668026:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.668123:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.668131:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668142:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.668146:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.668151:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668162:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668170:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668177:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668201:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783967102.668666:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.668673:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668688:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.668692:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.668696:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668707:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668715:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668722:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.668756:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783967102.669640:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.669650:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.669662:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.669666:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.669671:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.669683:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.669705:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.669714:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.669743:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783967102.669800:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783967102.669808:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669818:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.669822:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669832:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669849:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669858:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b31606822e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669892:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967102.669896:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669903:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.669907:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669915:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669927:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669934:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661df176/0x9269c8b316068235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669947:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.669950:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669956:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.669959:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669980:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669992:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.669999:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b31606823c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.670016:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.670018:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.670020:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.670349:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.670356:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.670364:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.670367:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.670371:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.670380:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.670389:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.670461:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.670542:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.670738:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783967102.671141:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.671147:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.671157:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.671159:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.671164:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.671173:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.671180:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.671187:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671464:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967102.671471:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671479:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.671483:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671491:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671504:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671523:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671540:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.671544:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671550:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.671553:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671561:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.671571:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.671572:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.671579:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.671581:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.673748:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.673880:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783967102.673892:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b31606824a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.674340:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.674617:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.674625:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.674704:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.674709:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.674715:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.675193:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.675203:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.675210:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.675266:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.675533:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.675540:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.675549:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.675558:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.675567:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.675585:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.675593:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316068251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.675610:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.675611:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.675613:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967102.681242:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967102.681258:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.681278:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=578s v=(0 0) 00010000:00010000:2.0:1783967102.681282:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967102.681289:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.681304:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.681331:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.681339:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.681361:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783967102.686215:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.686228:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686246:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.686251:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.686258:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686273:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686283:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686291:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686317:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783967102.686714:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783967102.686722:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686741:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967102.686746:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686755:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686797:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686810:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068258 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686831:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967102.686840:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686847:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967102.686851:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686872:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686883:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686890:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8bbbc1/0x9269c8b31606825f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783967102.686894:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.686900:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.686903:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.686905:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.686906:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967102.686908:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.686912:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.686916:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686925:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686934:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686940:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.686965:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967102.687092:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967102.687099:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.687107:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967102.687110:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.687129:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.687138:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.687139:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.687147:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700b0e37/0x9269c8b316068266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.687159:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.687161:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.687162:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967102.689053:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967102.689067:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.689098:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=578s v=(0 0) 00010000:00010000:1.0:1783967102.689103:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967102.689109:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.689123:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.689143:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.689152:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.689178:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967102.689326:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967102.689335:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.689344:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fc00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.689348:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.689357:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.689373:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.689381:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2cb731/0x9269c8b31606826d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.689402:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.689409:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.689411:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967102.691673:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.691694:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.691711:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.691723:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.691738:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.691807:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.691825:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.691833:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.691852:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.692245:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.692253:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692261:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.692266:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692274:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692302:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692309:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb167483/0x9269c8b316068274 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692325:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.692341:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.692343:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967102.692539:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.692545:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.692554:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.692558:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.692563:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.692580:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.692603:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.692623:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.692652:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.692918:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.692924:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692932:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.692936:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692943:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692955:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692962:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027dce4f2/0x9269c8b31606827b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.692974:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.692976:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.692978:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967102.693078:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.693083:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.693092:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.693095:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.693099:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.693108:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.693115:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.693121:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.693143:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967102.693445:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967102.693452:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.693461:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967102.693464:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.693471:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.693483:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.693490:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e20df331/0x9269c8b316068282 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967102.693508:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.693510:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967102.693512:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967102.694832:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967102.694851:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.694871:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=578s v=(0 0) 00010000:00010000:0.0:1783967102.694876:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967102.694881:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.694894:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.694904:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.694911:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967102.694929:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967102.695154:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967102.695161:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695169:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967102.695173:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695187:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695201:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695209:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9726148/0x9269c8b316068289 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695227:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.695229:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967102.695231:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967102.695825:0:18603:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967102.695832:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695842:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=578s v=(0 0) 00010000:00010000:1.0:1783967102.695845:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967102.695849:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695871:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695879:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695899:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967102.695916:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783967102.695965:0:18603:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:2.0:1783967102.696050:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967102.696057:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.696064:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc0f10230) 00000100:00100000:1.0:1783967102.696067:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17120:x1870624587972096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99893us (103583us total) trans 0 rc 0/0 00010000:00010000:2.0:1783967102.696068:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.696076:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967102.696077:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783967102.696087:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.696105:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb689ac/0x9269c8b316068290 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967102.696120:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.696122:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967102.696124:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967102.696187:0:17120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17120:1870624587972096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783967102.696201:0:17120:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1783967102.696338:0:17120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17120:1870624587972224:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783967102.696384:0:17120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967102.696433:0:17120:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783967102.696547:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972224 00000100:00100000:2.0:1783967102.696554:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972224 00000100:00100000:2.0:1783967102.696601:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967102.696610:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17120:x1870624587972224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783967102.696725:0:18604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1783967102.709090:0:18598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1783967102.709132:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783967102.709576:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17120:x1870624587972224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12962us (13186us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783967102.709587:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783967102.709678:0:17120:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1783967102.709687:0:17120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17120:1870624587972224:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783967102.709702:0:17120:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1783967103.543291:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967104.567213:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967104.887055:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587972352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967104.887166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967104.887257:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972352 00000100:00100000:0.0:1783967104.887269:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972352 00000100:00100000:0.0:1783967104.887349:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967104.887362:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587972352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783967104.887410:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783967104.887466:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587972352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967104.887475:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783967104.887514:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967104.887566:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587972352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967105.402628:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587972480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967105.402718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967105.402809:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972480 00000100:00100000:0.0:1783967105.402817:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972480 00000100:00100000:0.0:1783967105.402869:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783967105.402877:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587972480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967105.402911:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967105.402953:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587972480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967105.402960:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783967105.403008:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587972480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967105.407081:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587972608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967105.407169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967105.407435:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972608 00000100:00100000:0.0:1783967105.407444:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972608 00000100:00100000:0.0:1783967105.407496:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783967105.407508:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587972608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967105.407540:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783967105.407615:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587972608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967105.407622:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783967105.407671:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587972608:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783967105.594036:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967106.298818:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783967106.614999:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967107.640411:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967107.959134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967107.959142:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967107.959145:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967107.959153:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:1.0:1783967107.959157:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00100000:3.0:1783967107.959277:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587972864:0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.959353:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967107.959409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967107.959416:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587972736:0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.959445:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967107.959482:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972864 00000100:00100000:3.0:1783967107.959490:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972864 00000100:00100000:3.0:1783967107.959558:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783967107.959567:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587972864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.959620:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587972864:12345-0@lo:400:kworker.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967107.959627:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783967107.959662:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972736 00000100:00100000:3.0:1783967107.959667:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972736 00000100:00100000:3.0:1783967107.959691:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783967107.959697:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:3648:x1870624587972736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.959726:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:3648:x1870624587972736:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967107.959731:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783967107.959807:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587972736:0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.959837:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587972864:0@lo:400:kworker.0 00000100:00080000:1.0:1783967107.960094:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967107.960120:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddf80 x1870624587973120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967107.960253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967107.960256:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967107.960265:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967107.960269:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 578 00000100:00080000:1.0:1783967107.960272:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783967107.960276:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967107.960438:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587973376:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.960480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967107.960505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967107.960520:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587973504:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.960610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967107.960723:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587973248:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.960750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967107.961429:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2de300 x1870624587973632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967107.961653:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967107.961662:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587972992:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.961699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967107.961746:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973504 00000100:00100000:0.0:1783967107.961753:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973504 00000100:00100000:1.0:1783967107.961908:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587972992 00000100:00100000:1.0:1783967107.961912:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587972992 00000100:00100000:3.0:1783967107.962067:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587973120:0@lo:8:kworker.0 00000100:00100000:3.0:1783967107.962099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967107.962122:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587973632:0@lo:8:kworker.0 00000100:00100000:3.0:1783967107.962146:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967107.962318:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973120 00000100:00100000:0.0:1783967107.962323:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973120 00000100:00100000:0.0:1783967107.962333:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973632 00000100:00100000:0.0:1783967107.962336:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973632 00000100:00100000:0.0:1783967107.962346:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783967107.962408:0:18604:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783967107.962416:0:18604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783967107.962515:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973376 00000100:00100000:3.0:1783967107.962520:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973376 00000100:00100000:3.0:1783967107.962559:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783967107.962566:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587973376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.962617:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587973376:12345-0@lo:400:kworker.0 Request processed in 52us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967107.962625:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783967107.962659:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587974144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967107.962688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967107.962708:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967107.962715:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587974016:0@lo:400:kworker.0 00000100:00100000:3.0:1783967107.962741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967107.962816:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967107.962821:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587973120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783967107.962842:0:18604:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783967107.972957:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973248 00000100:00100000:1.0:1783967107.972973:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973248 00000100:00100000:1.0:1783967107.973023:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974016 00000100:00100000:1.0:1783967107.973027:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974016 00000100:00100000:1.0:1783967107.973048:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967107.973058:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587973248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.973146:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587973248:12345-0@lo:400:kworker.0 Request processed in 89us (12393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967107.973153:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967107.973240:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967107.973248:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587974016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.973351:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587974016:12345-0@lo:400:kworker.0 Request processed in 105us (10609us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967107.973358:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783967107.973406:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c2748700 x1870624587974016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967107.973423:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587974016:0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.973457:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587973760:0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.973503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967107.973531:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967107.973538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587973888:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.973860:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587973504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.973900:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587973504:12345-0@lo:400:kworker.0 Request processed in 11548us (13291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967107.973908:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783967107.973929:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967107.973933:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967107.973943:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974144 00000100:00100000:0.0:1783967107.973947:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974144 00000100:00100000:0.0:1783967107.973971:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783967107.973977:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587974144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783967107.973997:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783967107.974029:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624587974144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (11340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967107.974035:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783967107.974074:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587974144:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783967107.974100:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dce00 x1870624587973248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967107.974110:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587973248:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.974151:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587973504:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.974174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587973376:0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.974202:0:18603:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967107.974210:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967107.974215:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967107.974246:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587972992:12345-0@lo:400:kworker.0 Request processed in 31us (12546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967107.974252:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967107.974407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967107.974432:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973760 00000100:00100000:1.0:1783967107.974435:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973760 00000100:00100000:1.0:1783967107.974454:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587973888 00000100:00100000:1.0:1783967107.974457:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587973888 00000100:00100000:1.0:1783967107.974474:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967107.974479:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587973760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.974508:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587973760:12345-0@lo:400:kworker.0 Request processed in 29us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967107.974514:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967107.974524:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783967107.974529:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587973888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967107.974886:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587973888:12345-0@lo:400:kworker.0 Request processed in 356us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967107.974892:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783967107.974910:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967107.985430:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967107.985444:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587973632:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783967107.985471:0:19333:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967107.985720:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587972992:0@lo:400:kworker.0 00010000:00080000:1.0:1783967107.986391:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dca80 x1870624587973888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967107.986406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587973888:0@lo:400:kworker.0 00010000:00080000:1.0:1783967107.986422:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2ddc00 x1870624587973760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967107.986431:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587973760:0@lo:400:kworker.0 00000100:00100000:2.0:1783967107.987574:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587973632:12345-0@lo:8:kworker.0 Request processed in 2124us (25419us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967107.987589:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1783967107.995410:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967107.995426:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967107.995432:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587973632:0@lo:8:kworker.0 00000100:00100000:2.0:1783967108.016612:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587973120:12345-0@lo:8:kworker.0 Request processed in 53782us (54504us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967108.016627:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783967108.017803:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967108.017815:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967108.017820:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587973120:0@lo:8:kworker.0 00010000:00010000:2.0:1783967108.662938:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967108.983415:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783967109.695300:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783967109.760162:0:19415:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783967109.760166:0:19415:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783967109.760174:0:19415:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783967109.761108:0:19415:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a04c1f6f800 00000020:01000004:3.0:1783967109.761127:0:19415:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783967109.761145:0:19415:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783967109.761161:0:19415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a05ea23cd40) 00000020:00000080:3.0:1783967109.761181:0:19415:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783967109.855535:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783967109.863500:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1783967109.863890:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1783967109.864141:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1783967109.864694:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1783967109.865079:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1783967109.865826:0:19415:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1783967109.869101:0:19415:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1783967109.869406:0:19415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783967109.869421:0:19415:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783967109.869434:0:19415:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b31606829e 00000020:01000004:1.0:1783967109.869442:0:19415:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783967109.869464:0:19415:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783967109.869468:0:19415:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783967109.869475:0:19415:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783967109.869506:0:19415:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1783967109.869511:0:19415:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783967109.918957:0:19415:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783967109.919001:0:19415:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783967109.919006:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783967109.919007:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967109.919009:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967109.919010:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967109.919011:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967109.919012:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967109.919014:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967109.919016:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967109.919017:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967109.919021:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783967109.919023:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783967109.919024:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967109.919025:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967109.919026:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967109.919027:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967109.919028:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967109.919029:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967109.919030:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967109.919031:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967109.919058:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783967109.919078:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783967109.919166:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967109.919225:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699600 going to sleep for 11 seconds 00000100:00100000:1.0:1783967109.919309:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974272 00000100:00100000:1.0:1783967109.919316:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974272 00000100:00100000:1.0:1783967109.919378:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783967109.919388:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:19415:x1870624587974272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783967109.919438:0:17090:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783967109.919442:0:17090:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783967109.919446:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783967109.921670:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:19415:x1870624587974272:12345-0@lo:253:mount.lustre.0 Request processed in 2275us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967109.921685:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783967109.926019:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967109.926041:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783967109.926045:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967109.926047:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967109.926067:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967109.926068:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967109.926070:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967109.926071:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967109.926072:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967109.926074:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967109.926075:0:19415:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783967109.926100:0:19415:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a04c1f6f800 from lustre-OST0001 10000000:01000000:3.0:1783967109.926132:0:19415:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783967109.926135:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783967109.926145:0:19415:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a05c3468000 local copy 00010000:00010000:3.0:1783967109.926157:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967109.926440:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967109.926509:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967109.926638:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699000 going to sleep for 11 seconds 00000100:00100000:1.0:1783967109.929745:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974400 00000100:00100000:1.0:1783967109.929763:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974400 00000100:00100000:1.0:1783967109.929974:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783967109.929986:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:19415:x1870624587974400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967109.930151:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:19415:x1870624587974400:12345-0@lo:501:mount.lustre.0 Request processed in 168us (3642us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783967109.930159:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783967109.930270:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974400:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783967109.930296:0:19415:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783967109.930326:0:19415:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783967109.930335:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.930346:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967109.930382:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a04c1f6f800 10000000:01000000:0.0:1783967109.930388:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783967109.930409:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783967109.930412:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783967109.930417:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783967109.930420:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783967109.930453:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.930462:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.930472:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967109.930492:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967109.930528:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967109.931494:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967109.931788:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974528 00000100:00100000:3.0:1783967109.931797:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974528 00000100:00100000:3.0:1783967109.931846:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783967109.931856:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:19415:x1870624587974528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967109.931871:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967109.931888:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1000/0x9269c8b3160682ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160682a5 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.931916:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1000/0x9269c8b3160682ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160682a5 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.931927:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1000/0x9269c8b3160682ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160682a5 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.931936:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1000, rc 0) 00000100:00100000:3.0:1783967109.932009:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974528:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967109.932016:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783967109.932141:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967109.932156:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.932166:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967109.933735:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783967109.934405:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967109.944869:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783967109.944954:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783967109.944972:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783967109.944986:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783967109.945007:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783967109.945021:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783967109.945052:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783967109.945058:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783967109.945183:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967109.947443:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967109.947554:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1783967109.947997:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974656 00000100:00100000:3.0:1783967109.948007:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974656 00000100:00100000:3.0:1783967109.948112:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783967109.948125:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967109.948387:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974656:12345-0@lo:501:mount.lustre.0 Request processed in 265us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967109.948396:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783967109.948490:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967109.948554:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967109.948640:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967109.949060:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967109.949129:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974784 00000100:00100000:1.0:1783967109.949134:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974784 00000100:00100000:1.0:1783967109.949167:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783967109.949174:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967109.950286:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974784:12345-0@lo:503:mount.lustre.0 Request processed in 1108us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967109.950295:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783967109.950704:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974784:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783967109.951373:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967109.951483:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974912:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967109.951553:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967109.951996:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d176d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967109.952052:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587974912 00000100:00100000:1.0:1783967109.952058:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587974912 00000100:00100000:1.0:1783967109.952107:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783967109.952116:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967109.952805:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587974912:12345-0@lo:502:mount.lustre.0 Request processed in 688us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967109.952815:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783967109.952944:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587974912:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967109.953203:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783967109.953237:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783967109.953251:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783967109.953282:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783967109.953298:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783967109.953312:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783967109.953325:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783967109.953336:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783967109.953347:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783967109.953382:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967109.953434:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967109.953472:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967109.953961:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975040 00000100:00100000:3.0:1783967109.953968:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975040 00000100:00100000:3.0:1783967109.954022:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783967109.954031:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587975040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967109.954142:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587975040:12345-0@lo:502:mount.lustre.0 Request processed in 111us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967109.954149:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783967109.954249:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967109.954317:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783967109.954327:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1783967109.957179:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783967109.957193:0:19419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1783967109.957200:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.957202:0:19419:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783967109.957210:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783967109.957226:0:19419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a04c3478000) 00000020:00000080:2.0:1783967109.957257:0:19419:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783967109.957265:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783967109.957360:0:19419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c1f6f800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783967109.957370:0:19419:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783967109.957391:0:19419:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b3160682ba 00010000:00010000:2.0:1783967109.969323:0:19419:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1783967109.970501:0:19419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1783967109.975260:0:19419:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783967109.987051:0:19419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783967109.987064:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967109.987071:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.987073:0:19419:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783967109.987076:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967109.987081:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.987082:0:19419:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783967109.987085:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783967109.987087:0:19419:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783967109.987090:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967109.987092:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.987093:0:19419:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783967109.987095:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967109.987097:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.987099:0:19419:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783967109.987102:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783967109.987140:0:19419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967109.987143:0:19419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967109.987145:0:19419:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783967109.987163:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783967109.989093:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783967109.989143:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783967109.990048:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.990064:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967109.990073:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c1f6f800 from 1 10000000:01000000:3.0:1783967109.990076:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967109.990119:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.990137:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.990149:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967109.991159:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967109.991235:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967109.991283:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967109.997734:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975168 00000100:00100000:0.0:1783967109.997752:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975168 00000100:00100000:0.0:1783967109.997837:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783967109.997848:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:19415:x1870624587975168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967109.997884:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967109.997903:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160682c1 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.997933:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.997945:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967109.997954:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783967109.998030:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975168:12345-0@lo:101:mount.lustre.0 Request processed in 183us (6794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967109.998037:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783967109.999885:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967109.999914:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967109.999928:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967110.001425:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783967110.001766:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967110.002227:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783967110.002260:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783967110.002280:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783967110.002286:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783967110.002365:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967110.002442:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.002543:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967110.002923:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975296 00000100:00100000:1.0:1783967110.002932:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975296 00000100:00100000:1.0:1783967110.003001:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783967110.003013:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967110.003166:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975296:12345-0@lo:501:mount.lustre.0 Request processed in 155us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967110.003176:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783967110.003426:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967110.003472:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967110.003533:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.003684:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967110.003719:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975424 00000100:00100000:1.0:1783967110.003724:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975424 00000100:00100000:1.0:1783967110.003810:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783967110.003818:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967110.003967:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975424:12345-0@lo:503:mount.lustre.0 Request processed in 147us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967110.003976:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783967110.004104:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975424:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967110.004504:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967110.004574:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975552:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.004629:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.004661:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975552 00000100:00100000:3.0:1783967110.004665:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975552 00000100:00100000:3.0:1783967110.004688:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783967110.004695:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.004808:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975552:12345-0@lo:502:mount.lustre.0 Request processed in 112us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.004815:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783967110.004855:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699900 going to sleep for 11 seconds 00000100:00100000:3.0:1783967110.004870:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967110.005379:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783967110.005408:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1783967110.005421:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1783967110.005434:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1783967110.005445:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1783967110.005457:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1783967110.005470:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1783967110.005481:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1783967110.005493:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1783967110.005523:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1783967110.005539:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1783967110.005563:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.005620:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.005652:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975680 00000100:00100000:3.0:1783967110.005657:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975680 00000100:00100000:3.0:1783967110.005681:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783967110.005688:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.005761:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975680:12345-0@lo:502:mount.lustre.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.011124:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783967110.011285:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699900 going to sleep for 11 seconds 00000100:00100000:3.0:1783967110.011316:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967110.011409:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1783967110.011425:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:1.0:1783967110.012060:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587975808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967110.012147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.012375:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975808 00000100:00100000:3.0:1783967110.012384:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975808 00000100:00100000:3.0:1783967110.012449:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967110.012461:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587975808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783967110.012497:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783967110.012549:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587975808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.012557:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967110.012611:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587975808:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783967110.012685:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1783967110.012925:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967110.012936:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.012938:0:19423:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783967110.012945:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c1f6f800 00000020:00000080:3.0:1783967110.012947:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967110.012955:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967110.012977:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.012979:0:19423:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783967110.012982:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967110.012986:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.012987:0:19423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783967110.012991:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c1f6f800 00000020:00000080:3.0:1783967110.012993:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967110.013053:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967110.013057:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.013059:0:19423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783967110.013061:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967110.013063:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.013065:0:19423:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783967110.013068:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c1f6f800 00000020:00000080:3.0:1783967110.013070:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967110.013087:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967110.013089:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.013091:0:19423:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783967110.013093:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967110.013095:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.013097:0:19423:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783967110.013100:0:19423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c1f6f800 00000020:00000080:3.0:1783967110.013103:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967110.013125:0:19423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967110.013129:0:19423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967110.013130:0:19423:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783967110.013133:0:19423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1783967110.013274:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1783967110.013310:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783967110.013336:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967110.013347:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967110.013403:0:19415:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783967110.013406:0:19415:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a04c1f6f800 10000000:01000000:1.0:1783967110.013408:0:19415:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a04c1f6f800 10000000:01000000:1.0:1783967110.013413:0:19415:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783967110.013418:0:19415:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a04c1f6f800 from 1 10000000:01000000:1.0:1783967110.013421:0:19415:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783967110.013455:0:19415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967110.013465:0:19415:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967110.013475:0:19415:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967110.013496:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967110.013542:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967110.013569:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1783967110.014931:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587975936 00000100:00100000:0.0:1783967110.014945:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587975936 00000100:00100000:0.0:1783967110.015014:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783967110.015024:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+23:19415:x1870624587975936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967110.015041:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967110.015058:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1400/0x9269c8b3160682d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160682cf expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967110.015085:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1400/0x9269c8b3160682d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160682cf expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967110.015095:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1400/0x9269c8b3160682d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160682cf expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967110.015104:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1400, rc 0) 00000100:00100000:0.0:1783967110.015197:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587975936:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967110.015204:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783967110.015335:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587975936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967110.015358:0:19415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.015370:0:19415:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967110.016719:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1783967110.017036:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967110.017242:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783967110.017287:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783967110.017302:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783967110.017315:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783967110.017328:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783967110.017341:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783967110.017354:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783967110.017369:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783967110.017383:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783967110.017397:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783967110.017409:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783967110.017423:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783967110.017436:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783967110.017450:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783967110.017462:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783967110.017489:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783967110.017505:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783967110.017518:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783967110.017532:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783967110.017545:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783967110.017561:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783967110.017576:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783967110.017601:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783967110.017620:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783967110.017636:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1783967110.017652:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1783967110.017664:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1783967110.017677:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1783967110.017695:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1783967110.017726:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1783967110.017741:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1783967110.017799:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1783967110.017823:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1783967110.017839:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1783967110.017855:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1783967110.017873:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1783967110.017889:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1783967110.017907:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1783967110.017923:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1783967110.017934:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1783967110.017948:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1783967110.017966:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1783967110.017985:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1783967110.018005:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1783967110.018027:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1783967110.018050:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1783967110.018076:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1783967110.018083:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1783967110.018171:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967110.018237:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.018285:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976064 00000100:00100000:3.0:1783967110.018292:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976064 00000100:00100000:3.0:1783967110.018334:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783967110.018342:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967110.018453:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976064:12345-0@lo:501:mount.lustre.0 Request processed in 110us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.018460:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783967110.018503:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699600 going to sleep for 11 seconds 00000100:00100000:3.0:1783967110.018524:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967110.018566:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967110.018623:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.018643:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976192 00000100:00100000:3.0:1783967110.018647:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976192 00000100:00100000:3.0:1783967110.018664:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783967110.018669:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967110.018739:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976192:12345-0@lo:503:mount.lustre.0 Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.018745:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783967110.018802:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699600 going to sleep for 11 seconds 00000100:00100000:3.0:1783967110.018816:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967110.019132:0:19415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967110.019202:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.019237:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.019268:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967110.019726:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976320 00000100:00100000:0.0:1783967110.019732:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976320 00000100:00100000:0.0:1783967110.019800:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783967110.019808:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967110.019922:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976320:12345-0@lo:502:mount.lustre.0 Request processed in 114us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967110.019930:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783967110.022588:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967110.022881:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783967110.022922:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783967110.022940:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783967110.023157:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783967110.023181:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783967110.023198:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783967110.023211:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783967110.023228:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783967110.023244:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783967110.023338:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783967110.023356:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783967110.023405:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783967110.023425:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783967110.023443:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783967110.023463:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783967110.023484:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783967110.023506:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783967110.023953:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783967110.024065:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783967110.024084:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783967110.024103:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783967110.024118:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783967110.024135:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783967110.024158:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783967110.024178:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1783967110.024198:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1783967110.024219:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1783967110.024252:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1783967110.024506:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1783967110.024524:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1783967110.024538:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1783967110.024552:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1783967110.024571:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1783967110.024588:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1783967110.024617:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1783967110.024633:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1783967110.024648:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1783967110.024664:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1783967110.024680:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1783967110.024696:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1783967110.024713:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1783967110.024728:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1783967110.024742:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1783967110.028542:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1783967110.028619:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1783967110.028638:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1783967110.028653:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1783967110.028666:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1783967110.028736:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.028861:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.028911:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967110.032782:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976448 00000100:00100000:0.0:1783967110.032799:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976448 00000100:00100000:0.0:1783967110.032860:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783967110.032869:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967110.033061:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976448:12345-0@lo:502:mount.lustre.0 Request processed in 192us (4200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967110.033070:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783967110.033287:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967110.033522:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1783967110.033570:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1783967110.033618:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967110.034795:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.034841:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967110.034916:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976576 00000100:00100000:0.0:1783967110.034922:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976576 00000100:00100000:0.0:1783967110.034965:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783967110.034974:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967110.035101:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587976576:12345-0@lo:502:mount.lustre.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967110.035109:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783967110.035195:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587976576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967110.035262:0:19415:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1783967110.035275:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783967110.041096:0:19427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783967110.041118:0:19427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a05ea238000) 00000020:00000080:3.0:1783967110.041150:0:19427:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1783967110.041374:0:19427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c1f6f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967110.041380:0:19427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c1f6f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967110.041384:0:19427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c1f6f800 3 00010000:00080000:3.0:1783967110.041425:0:19427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3485000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967110.047905:0:19427:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783967110.048040:0:19427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783967110.048096:0:19427:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967110.048116:0:19427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9269c8b3160682e4 00000100:00080000:3.0:1783967110.048128:0:19427:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967110.048142:0:19427:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c3485000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967110.048184:0:19427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3fd2a00 x1870624587976704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967110.048212:0:19427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783967110.048279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967110.048283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967110.048286:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967110.048290:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:3.0:1783967110.048293:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783967110.048297:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967110.048322:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3fd2300 x1870624587977088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967110.048360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967110.048363:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967110.048365:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967110.048369:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:3.0:1783967110.048371:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783967110.048375:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967110.048388:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3fd3100 x1870624587977472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783967110.048436:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587976832:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048547:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587977600:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048618:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783967110.048625:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587977344:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587976960:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048720:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587977728:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783967110.048763:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587977216:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048825:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587977856:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048846:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.048871:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976832 00000100:00100000:3.0:1783967110.048878:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976832 00000100:00100000:3.0:1783967110.048911:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977344 00000100:00100000:3.0:1783967110.048914:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977344 00000100:00100000:3.0:1783967110.048928:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783967110.048936:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.048988:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587976832:12345-0@lo:400:kworker.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.048996:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783967110.049011:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783967110.049017:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587977344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049046:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587977344:12345-0@lo:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049051:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783967110.049078:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977600 00000100:00100000:3.0:1783967110.049082:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977600 00000100:00100000:3.0:1783967110.049101:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977728 00000100:00100000:3.0:1783967110.049104:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977728 00000100:00100000:3.0:1783967110.049129:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977216 00000100:00100000:3.0:1783967110.049132:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977216 00000100:00100000:3.0:1783967110.049144:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977856 00000100:00100000:3.0:1783967110.049146:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977856 00000100:00100000:3.0:1783967110.049159:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967110.049164:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587977600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049195:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587977600:12345-0@lo:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049202:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967110.049213:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967110.049222:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587977728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049252:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587977728:12345-0@lo:400:kworker.0 Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049258:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967110.049271:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783967110.049277:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587977216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049321:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587977216:12345-0@lo:400:kworker.0 Request processed in 44us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049328:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783967110.049340:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783967110.049346:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587977856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049374:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587977856:12345-0@lo:400:kworker.0 Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049389:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783967110.049411:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976960 00000100:00100000:3.0:1783967110.049415:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976960 00000100:00100000:3.0:1783967110.049446:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967110.049452:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587976960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049482:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587976960:12345-0@lo:400:kworker.0 Request processed in 31us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.049488:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967110.049531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587977344:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049542:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587976832:0@lo:400:kworker.0 00010000:00080000:3.0:1783967110.049551:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3fd0700 x1870624587977600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967110.049560:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587977600:0@lo:400:kworker.0 00000100:00080000:3.0:1783967110.049584:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967110.049589:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967110.049604:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783967110.049620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3fd0e00 x1870624587977216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967110.049641:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587977216:0@lo:400:kworker.0 00010000:00080000:3.0:1783967110.049651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3fd0000 x1870624587977856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967110.049658:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587977856:0@lo:400:kworker.0 00000100:00100000:3.0:1783967110.049668:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587976960:0@lo:400:kworker.0 00010000:00080000:3.0:1783967110.049687:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3fd2680 x1870624587977728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967110.049695:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587977728:0@lo:400:kworker.0 00000100:00100000:1.0:1783967110.050302:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587976704:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967110.050368:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967110.050420:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587977088:0@lo:8:kworker.0 00000100:00100000:1.0:1783967110.050450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967110.050475:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587977472:0@lo:8:kworker.0 00000100:00100000:2.0:1783967110.050482:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977088 00000100:00100000:2.0:1783967110.050489:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977088 00000100:00100000:1.0:1783967110.050500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967110.055403:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977472 00000100:00100000:2.0:1783967110.055421:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977472 00000100:00100000:2.0:1783967110.055469:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967110.055477:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587977088:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783967110.055611:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587977088:12345-0@lo:8:kworker.0 Request processed in 133us (5159us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783967110.055619:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967110.055760:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967110.055764:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587977472:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783967110.055820:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624587977472:12345-0@lo:8:kworker.0 Request processed in 53us (5320us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783967110.055826:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967110.056090:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967110.056098:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967110.056103:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783967110.056107:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587977088:0@lo:8:kworker.0 00000100:00100000:2.0:1783967110.056121:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967110.056125:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967110.056128:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783967110.056131:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587977472:0@lo:8:kworker.0 00000100:00100000:3.0:1783967110.058097:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587976704 00000100:00100000:3.0:1783967110.058113:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587976704 00000100:00100000:3.0:1783967110.058169:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783967110.058178:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624587976704:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783967110.058207:0:17095:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:3.0:1783967110.058266:0:17095:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9269c8b3160682eb 00000004:00100000:3.0:1783967110.058285:0:17095:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783967110.058325:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9a04c2493800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967110.058424:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870624587976704:12345-0@lo:38:llog_process_th.0 Request processed in 245us (8055us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.058431:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1783967110.058566:0:19427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00010000:00080000:2.0:1783967110.058706:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3fd2a00 x1870624587976704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967110.058718:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967110.058728:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783967110.058742:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783967110.058746:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783967110.058749:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967110.058755:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624587976704:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1783967110.060359:0:19427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a04c249cd40) 00000020:00000080:3.0:1783967110.060393:0:19427:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1783967110.060833:0:19427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c1f6f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967110.060839:0:19427:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c1f6f800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967110.060842:0:19427:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c1f6f800 3 00010000:00080000:3.0:1783967110.060874:0:19427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c2490800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967110.062497:0:19427:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1783967110.062634:0:19427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783967110.062682:0:19427:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967110.062695:0:19427:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9269c8b3160682f9 00000100:00080000:3.0:1783967110.062705:0:19427:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967110.062711:0:19427:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a04c2490800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967110.062758:0:19427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05c7d69c00 x1870624587977984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967110.062809:0:19427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783967110.063617:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587977984:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967110.063695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967110.063758:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587977984 00000100:00100000:2.0:1783967110.063766:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587977984 00000100:00100000:2.0:1783967110.063826:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967110.063833:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624587977984:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783967110.063862:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:2.0:1783967110.063896:0:17097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9269c8b316068300 00000004:00100000:2.0:1783967110.063914:0:17097:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783967110.063954:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f28000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967110.064006:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870624587977984:12345-0@lo:38:llog_process_th.0 Request processed in 171us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967110.064013:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783967110.064054:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05c7d69c00 x1870624587977984/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967110.064064:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967110.064072:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783967110.064079:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783967110.064084:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783967110.064086:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c2490800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967110.064092:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624587977984:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783967110.067334:0:19427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1783967110.067532:0:19415:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783967110.067561:0:19415:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783967110.067584:0:19415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967110.067605:0:19415:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783967110.067681:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783967110.067684:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783967110.067685:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967110.067686:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967110.067687:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967110.067688:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967110.067690:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967110.067692:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967110.067693:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967110.067696:0:19415:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1783967110.067698:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967110.067699:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783967110.067701:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967110.067701:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967110.067702:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967110.067703:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967110.067704:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967110.067705:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967110.067706:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783967110.067734:0:19415:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783967110.067754:0:19415:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587978112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967110.067877:0:19415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967110.067918:0:19415:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967110.075977:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978112 00000100:00100000:0.0:1783967110.075992:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978112 00000100:00100000:0.0:1783967110.076060:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783967110.076077:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587978112:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783967110.076113:0:17090:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783967110.076130:0:17090:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783967110.078076:0:17090:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783967110.078095:0:17090:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783967110.078405:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:19415:x1870624587978112:12345-0@lo:253:mount.lustre.0 Request processed in 2326us (10523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967110.078428:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783967110.078504:0:19415:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3b28c549-2862-472c-a00b-4682deda9da4:19415:1870624587978112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783967110.078519:0:19415:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783967110.078522:0:19415:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783967110.078524:0:19415:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783967110.078526:0:19415:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967110.078527:0:19415:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967110.078528:0:19415:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967110.078529:0:19415:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967110.078530:0:19415:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967110.078532:0:19415:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967110.078534:0:19415:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783967110.078549:0:19415:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783967110.084170:0:17111:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783967110.084181:0:17111:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783967110.084207:0:17111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084226:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084235:0:17111:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160681be expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084243:0:17111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084297:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 23 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084312:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 23 pid: 17090 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967110.084327:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587978240:0@lo:104: 00000100:00100000:3.0:1783967110.084396:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783967110.084453:0:17111:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084463:0:17111:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 23 pid: 17091 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967110.084480:0:17111:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587978368:0@lo:104: 00000100:00100000:3.0:1783967110.084505:0:17111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.084526:0:17111:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f5699d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967110.084550:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978240 00000100:00100000:3.0:1783967110.084557:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978240 00000100:00100000:3.0:1783967110.084603:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978368 00000100:00100000:3.0:1783967110.084607:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978368 00000100:00100000:3.0:1783967110.084632:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967110.084642:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587978240:12345-0@lo:104: 00010000:00010000:3.0:1783967110.084655:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084707:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783967110.084713:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:17111:x1870624587978240:12345-0@lo:104: Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.084721:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967110.084741:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967110.084747:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587978368:12345-0@lo:104: 00010000:00010000:3.0:1783967110.084755:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084814:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783967110.084819:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:17111:x1870624587978368:12345-0@lo:104: Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.084825:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1783967110.084843:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967110.084850:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084864:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967110.084869:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084878:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967110.084885:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967110.084891:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783967110.084926:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084933:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967110.084953:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084960:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5630a00/0x9269c8b3160681be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681c5 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084972:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967110.084975:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.084981:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967110.084983:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085002:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967110.085007:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967110.085011:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783967110.085025:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085030:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967110.085036:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085042:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b3160681b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160681b7 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085053:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967110.085054:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967110.085056:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967110.085063:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967110.085076:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587978496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967110.085105:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.085135:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967110.085141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587978624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967110.085162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967110.085187:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978496 00000100:00100000:1.0:1783967110.085194:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978496 00000100:00100000:3.0:1783967110.085197:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978624 00000100:00100000:3.0:1783967110.085203:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978624 00010000:00010000:1.0:1783967110.085222:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 25 pid: 17090 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085229:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 25 pid: 17091 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967110.085251:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967110.085260:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+25:3645:x1870624587978496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967110.085270:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967110.085275:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 25 pid: 17090 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967110.085284:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 25 pid: 17090 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967110.085300:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967110.085332:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+25:3645:x1870624587978496:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967110.085361:0:17081:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783967110.085369:0:17081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783967110.085576:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967110.085586:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+25:3645:x1870624587978624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967110.085603:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967110.085608:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 25 pid: 17091 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085619:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 25 pid: 17091 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085678:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085686:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783967110.085699:0:17083:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.036591042s 00010000:00010000:3.0:1783967110.085703:0:17083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085711:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085717:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085725:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085731:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967110.085744:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085751:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085760:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085788:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967110.085818:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+25:3645:x1870624587978624:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967110.085826:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967110.085861:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587978624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967110.085868:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587978496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967110.085898:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631200/0x9269c8b3160681c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160681be expref: 24 pid: 17090 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967110.085908:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587978240:0@lo:104: 00010000:00010000:3.0:1783967110.085916:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630c00/0x9269c8b3160681b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160681b0 expref: 23 pid: 17091 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967110.085923:0:17111:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17111:1870624587978368:0@lo:104: 00010000:00010000:3.0:1783967110.085934:0:17111:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085942:0:17111:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085959:0:17111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967110.085964:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068307 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1783967110.088515:0:19415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1783967110.091228:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:2.0:1783967110.096685:0:19415:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783967110.096696:0:19415:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783967110.096741:0:19415:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783967110.096825:0:19415:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783967110.096847:0:19415:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783967110.096876:0:19415:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1783967110.097713:0:19415:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783967110.097984:0:19415:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783967110.519301:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587978880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967110.519398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967110.519453:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967110.519460:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587978752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967110.519485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967110.519567:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978880 00000100:00100000:2.0:1783967110.519576:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978880 00000100:00100000:2.0:1783967110.519630:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587978752 00000100:00100000:2.0:1783967110.519633:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587978752 00000100:00100000:2.0:1783967110.519648:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783967110.519655:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587978880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967110.519697:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967110.519757:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587978880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967110.519819:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783967110.519840:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783967110.519845:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587978752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967110.519865:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783967110.519895:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587978752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967110.519901:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783967110.520073:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587978752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967110.520085:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587978880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783967110.718934:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783967111.507444:0:19483:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967111.507733:0:19483:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1783967111.678989:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783967111.679002:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c2f6c000 from 10 10000000:01000000:3.0:1783967111.679008:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783967111.679064:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.679077:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.679089:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967111.679140:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967111.680520:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967111.680591:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b180 going to sleep for 11 seconds 00000100:00100000:0.0:1783967111.680864:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979008 00000100:00100000:0.0:1783967111.680880:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979008 00000100:00100000:0.0:1783967111.680959:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783967111.680969:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587979008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967111.680986:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967111.681004:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b31606830e expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967111.681035:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b31606830e expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967111.681048:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b31606830e expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967111.681059:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783967111.681125:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587979008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967111.681132:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783967111.681861:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967111.681886:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.681897:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967111.681978:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967111.682025:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967111.682061:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783967111.682275:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979136 00000100:00100000:3.0:1783967111.682280:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979136 00000100:00100000:3.0:1783967111.682334:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783967111.682344:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587979136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783967111.682364:0:17090:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783967111.682382:0:17090:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783967111.682386:0:17090:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1783967111.682473:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587979136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967111.682481:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783967111.682518:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783967111.682615:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967111.682630:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.682639:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967111.682650:0:17093:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783967111.682652:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05fcff7800 from 10 10000000:01000000:3.0:1783967111.682655:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783967111.682685:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.682692:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.682701:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967111.682715:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967111.682741:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967111.682914:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655240 going to sleep for 11 seconds 00000100:00100000:3.0:1783967111.682931:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979264 00000100:00100000:3.0:1783967111.682936:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979264 00000100:00100000:3.0:1783967111.682964:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783967111.682970:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587979264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967111.682980:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967111.682995:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b31606831c expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.683018:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b31606831c expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.683040:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b31606831c expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.683048:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:3.0:1783967111.683078:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587979264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967111.683084:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783967111.683113:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967111.683126:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.683133:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967111.683172:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967111.683197:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967111.683209:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea655240 going to sleep for 11 seconds 00000100:00100000:3.0:1783967111.683534:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979392 00000100:00100000:3.0:1783967111.683539:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979392 00000100:00100000:3.0:1783967111.683620:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783967111.683628:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587979392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783967111.683643:0:17091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783967111.683658:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783967111.683661:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1783967111.683733:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587979392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967111.683747:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783967111.683942:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587979392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783967111.683994:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967111.684001:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967111.684010:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967111.737449:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967112.761127:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967113.079052:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967113.080420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587979520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783967113.080686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967113.084003:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979520 00000100:00100000:3.0:1783967113.084018:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979520 00000100:00100000:2.0:1783967113.088880:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967113.088900:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587979520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967113.088940:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783967113.089042:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587979520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (8356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967113.089050:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783967113.089154:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967113.090404:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587979520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783967113.783993:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967114.814846:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967115.127132:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587979648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967115.127219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967115.127323:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979648 00000100:00100000:1.0:1783967115.127331:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979648 00000100:00100000:1.0:1783967115.127398:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967115.127408:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587979648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967115.127448:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967115.127494:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587979648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.127512:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1783967115.127572:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967115.127615:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587979648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783967115.128087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967115.128092:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967115.128095:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967115.128102:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a05ed1cb800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967115.128122:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddc00 x1870624587980160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967115.128163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967115.128166:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967115.128168:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967115.128173:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f4cb0000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967115.128183:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ded80 x1870624587980544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967115.128229:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587980032:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128291:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587980800:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128317:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128337:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783967115.128344:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587980288:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128381:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587980928:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128425:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587979904:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128478:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587980672:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128513:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128524:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587981184:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.128545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.128569:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783967115.128575:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587979776:0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.128842:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980800 00000100:00100000:1.0:1783967115.128848:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980800 00000100:00100000:1.0:1783967115.128887:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980288 00000100:00100000:1.0:1783967115.128890:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980288 00000100:00100000:1.0:1783967115.128901:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980928 00000100:00100000:1.0:1783967115.128903:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980928 00000100:00100000:1.0:1783967115.128916:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980672 00000100:00100000:1.0:1783967115.128918:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980672 00000100:00100000:1.0:1783967115.128929:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981184 00000100:00100000:1.0:1783967115.128931:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981184 00000100:00100000:1.0:1783967115.128945:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967115.128953:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587980800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129003:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587980800:12345-0@lo:400:kworker.0 Request processed in 50us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129009:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967115.129024:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783967115.129030:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587980288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129057:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587980288:12345-0@lo:400:kworker.0 Request processed in 27us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129063:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783967115.129075:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783967115.129081:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587980928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129107:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624587980928:12345-0@lo:400:kworker.0 Request processed in 26us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129120:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783967115.129133:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967115.129139:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587980672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129166:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587980672:12345-0@lo:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129172:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967115.129183:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967115.129189:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587981184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129213:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587981184:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129219:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967115.129237:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980032 00000100:00100000:1.0:1783967115.129240:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980032 00000100:00100000:1.0:1783967115.129266:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967115.129272:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587980032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.129302:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587980032:12345-0@lo:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.129308:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967115.129329:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587980160:0@lo:8:kworker.0 00000100:00100000:1.0:1783967115.129356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967115.129370:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587980544:0@lo:8:kworker.0 00000100:00100000:1.0:1783967115.129405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.129493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.129533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587980416:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.129556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.129575:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587981056:0@lo:400:kworker.0 00000100:00100000:2.0:1783967115.129897:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980160 00000100:00100000:2.0:1783967115.129902:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980160 00000100:00100000:2.0:1783967115.129934:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980544 00000100:00100000:2.0:1783967115.129937:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980544 00000100:00100000:2.0:1783967115.129947:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783967115.129953:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587980160:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783967115.129980:0:18604:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:2.0:1783967115.130011:0:18604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b31606832a 00002000:00100000:2.0:1783967115.130027:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a04c1f2b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783967115.130031:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783967115.130034:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783967115.130219:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783967115.130250:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f2d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967115.130309:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624587980160:12345-0@lo:8:kworker.0 Request processed in 354us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967115.130317:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783967115.130332:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783967115.130337:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624587980544:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783967115.130351:0:18604:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:2.0:1783967115.130366:0:18604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316068331 00002000:00100000:2.0:1783967115.130373:0:18604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c1f28800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783967115.130375:0:18604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1783967115.130377:0:18604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783967115.130405:0:18604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1783967115.130418:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f2a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967115.130446:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624587980544:12345-0@lo:8:kworker.0 Request processed in 108us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967115.130453:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1783967115.130520:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783967115.130525:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783967115.130527:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783967115.130556:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2ddc00 x1870624587980160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967115.130570:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783967115.130578:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783967115.130583:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783967115.130585:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783967115.130729:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979776 00000100:00100000:1.0:1783967115.130734:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979776 00000100:00100000:1.0:1783967115.130767:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783967115.130793:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624587979776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967115.130827:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624587979776:12345-0@lo:400:kworker.0 Request processed in 35us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.130834:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:2.0:1783967115.130923:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783967115.130929:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624587980160:0@lo:8:kworker.0 00010000:00080000:2.0:1783967115.130947:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2ded80 x1870624587980544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967115.130959:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783967115.130964:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783967115.130968:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783967115.130970:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783967115.130988:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783967115.130992:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624587980544:0@lo:8:kworker.0 00000004:00080000:2.0:1783967115.131042:0:17840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783967115.131059:0:17840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981440:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783967115.131088:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967115.131105:0:17840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d0c6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783967115.131117:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981440 00000100:00100000:2.0:1783967115.131120:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981440 00000100:00100000:2.0:1783967115.131144:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967115.131150:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17840:x1870624587981440:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1783967115.131356:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1783967115.131491:0:17121:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783967115.131586:0:17121:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 591332816110ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783967115.131603:0:17121:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1783967115.131628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783967115.131639:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587981312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967115.131669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967115.131697:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981312 00000100:00100000:1.0:1783967115.131700:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981312 00000100:00100000:1.0:1783967115.131725:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967115.131731:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870624587981312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967115.131750:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967115.131811:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870624587981312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.131817:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783967115.131849:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c372ad80 x1870624587981312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967115.131864:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587981312:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1783967115.132757:0:17839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783967115.135260:0:17839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 591336487836ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783967115.135273:0:17839:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1783967115.138471:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783967115.138752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783967115.138839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2df480 x1870624587980672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.138856:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587980672:0@lo:400:kworker.0 00010000:00080000:0.0:1783967115.138870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44ef800 x1870624587981184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.138879:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587981184:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.138903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587979776:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.138927:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981056 00000100:00100000:0.0:1783967115.138934:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981056 00000100:00100000:0.0:1783967115.138990:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783967115.138998:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587981056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.139054:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587981056:12345-0@lo:400:kworker.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967115.139062:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783967115.139089:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587979904 00000100:00100000:0.0:1783967115.139093:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587979904 00000100:00100000:0.0:1783967115.139110:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587980416 00000100:00100000:0.0:1783967115.139113:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587980416 00000100:00100000:0.0:1783967115.139126:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967115.139132:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587979904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.139182:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587979904:12345-0@lo:400:kworker.0 Request processed in 49us (10731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967115.139189:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967115.139201:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967115.139207:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587980416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.139232:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587980416:12345-0@lo:400:kworker.0 Request processed in 26us (9675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967115.139238:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:2.0:1783967115.140432:0:17829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783967115.140589:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587981568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967115.140661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783967115.140765:0:17122:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1783967115.140803:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17122:1870624587981696:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783967115.140831:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.140851:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c5d80 going to sleep for 11 seconds 00000100:00080000:0.0:1783967115.140880:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967115.140895:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981696 00000100:00100000:0.0:1783967115.140901:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981696 00000100:00100000:0.0:1783967115.140950:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967115.140959:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17122:x1870624587981696:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1783967115.141171:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783967115.141204:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dca80 x1870624587980288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.141219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587980288:0@lo:400:kworker.0 00010000:00080000:0.0:1783967115.141234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44ed500 x1870624587980928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.141242:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624587980928:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.141254:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587980032:0@lo:400:kworker.0 00010000:00080000:0.0:1783967115.141274:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dce00 x1870624587980800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.141282:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587980800:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.141318:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587980416:0@lo:400:kworker.0 00010000:00080000:0.0:1783967115.141329:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44eea00 x1870624587981056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967115.141338:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587981056:0@lo:400:kworker.0 00000100:00100000:0.0:1783967115.141349:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587979904:0@lo:400:kworker.0 00002000:00080000:3.0:1783967115.144275:0:18604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1783967115.144287:0:18604:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783967115.144469:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17840:x1870624587981440:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13313us (13374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967115.144481:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783967115.144569:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3729500 x1870624587981440/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783967131 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967115.144586:0:17840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981440:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783967115.144603:0:17840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783967115.144650:0:17840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981824:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783967115.144684:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967115.144717:0:17840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9546780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967115.144734:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981824 00000100:00100000:3.0:1783967115.144740:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981824 00000100:00100000:3.0:1783967115.144799:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967115.144808:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17840:x1870624587981824:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783967115.144953:0:18601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1783967115.144990:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17840:x1870624587981824:12345-0@lo:5:osp-pre-1-1.0 Request processed in 183us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967115.144997:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783967115.145024:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c7d68380 x1870624587981824/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967131 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967115.145033:0:17840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981824:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783967115.145041:0:17840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783967115.145065:0:17840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981952:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783967115.145086:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967115.145100:0:17840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9546780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967115.145110:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981952 00000100:00100000:3.0:1783967115.145113:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981952 00000100:00100000:3.0:1783967115.145133:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783967115.145138:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17840:x1870624587981952:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783967115.145294:0:18604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:1.0:1783967115.147006:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587981568 00000100:00100000:1.0:1783967115.147016:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587981568 00000100:00100000:1.0:1783967115.147062:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967115.147071:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870624587981568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967115.147094:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00002000:00080000:0.0:1783967115.147275:0:19333:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783967115.147282:0:19333:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1783967115.147288:0:19333:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000100:00100000:1.0:1783967115.148759:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1870624587981568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1683us (8091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.148784:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783967115.153198:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c44ef800 x1870624587981568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967115.153231:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587981568:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1783967115.167939:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.167951:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.167968:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.167974:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.167981:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.167998:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168009:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168024:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168043:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967115.168126:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967115.168134:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.168142:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967115.168147:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.168156:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.168174:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.168182:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068338 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.168200:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.168202:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.168204:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967115.168543:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.168549:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168725:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.168730:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.168735:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168744:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168751:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168758:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.168786:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967115.169079:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967115.169085:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.169094:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967115.169097:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.169105:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.169118:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.169125:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606833f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.169137:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.169144:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.169146:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967115.171965:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967115.171979:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.172000:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=591s v=(0 0) 00010000:00010000:1.0:1783967115.172010:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967115.172017:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.172031:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.172041:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.172049:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.172068:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.172279:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.172288:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.172296:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.172306:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.172315:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.172335:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.172344:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018789e97/0x9269c8b316068346 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.172359:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.172362:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.172363:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967115.173302:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967115.173311:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.173323:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=591s v=(0 0) 00010000:00010000:1.0:1783967115.173327:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967115.173332:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.173342:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.173351:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.173363:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.173387:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.173686:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.173693:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.173701:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.173706:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.173714:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.173728:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.173742:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090203135/0x9269c8b31606834d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.173756:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.173758:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.173760:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967115.175051:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967115.175060:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175074:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=591s v=(0 0) 00010000:00010000:1.0:1783967115.175077:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967115.175083:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175094:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175103:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175111:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175130:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967115.175248:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967115.175255:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175269:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967115.175274:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175282:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175296:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175304:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ee01192/0x9269c8b316068354 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.175317:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.175319:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.175320:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967115.176320:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967115.176329:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.176341:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=591s v=(0 0) 00010000:00010000:1.0:1783967115.176344:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967115.176350:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.176361:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.176376:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.176384:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.176437:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.177508:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.177517:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.177529:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.177533:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.177544:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.177942:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.177952:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf5b05c1/0x9269c8b31606835b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.177970:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.177972:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.177974:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967115.180351:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.180368:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.180393:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.180398:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.180406:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.180421:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.180432:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.180439:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.180586:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.181472:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.181481:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.181491:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.181506:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.181517:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.181535:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.181543:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027dce4f2/0x9269c8b316068362 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.181563:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.181566:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.181567:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783967115.182622:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1783967115.182644:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783967115.182656:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1783967115.183044:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.183053:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.183068:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.183072:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.183078:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967115.183085:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17840:x1870624587981952:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37941us (37993us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783967115.183095:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1783967115.183104:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.183114:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.183121:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967115.183198:0:17840:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783967115.183207:0:17840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17840:1870624587981952:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783967115.183223:0:17840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783967115.183281:0:17840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17840:1870624587982080:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783967115.183322:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967115.183348:0:17840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08b180 going to sleep for 11 seconds 00000100:00100000:1.0:1783967115.183369:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982080 00000100:00100000:1.0:1783967115.183375:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982080 00000100:00100000:1.0:1783967115.183413:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967115.183422:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1870624587982080:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783967115.183466:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1870624587982080:12345-0@lo:900:osp-pre-1-1.0 Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.183472:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783967115.183604:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2748000 x1870624587982080/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967131 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967115.183614:0:17840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17840:1870624587982080:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1783967115.183693:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783967115.184252:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.184261:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.184275:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.184279:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.184286:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.184296:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.184304:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.184322:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184417:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967115.184425:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184433:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.184444:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184454:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184472:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184480:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb167483/0x9269c8b316068369 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184509:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.184513:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184520:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.184523:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184530:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184540:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184546:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.184552:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.184554:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.184613:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783967115.184618:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bec4e9/0x9269c8b316068370 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.184758:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967115.185023:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.185035:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185044:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.185048:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.185052:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185062:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185070:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185077:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185108:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783967115.185458:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.185464:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185472:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.185475:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.185478:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185487:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185508:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185516:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.185538:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783967115.186132:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967115.186139:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.186148:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=591s v=(0 0) 00010000:00010000:0.0:1783967115.186347:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967115.186352:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.186362:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.186371:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.186441:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187374:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783967115.187374:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783967115.187383:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187393:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967115.187413:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187422:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187438:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187446:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068377 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187461:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783967115.187464:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187470:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967115.187473:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187507:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187518:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187525:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b31606837e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187537:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967115.187540:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187546:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967115.187548:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187556:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187566:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187572:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076554d54/0x9269c8b316068385 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.187595:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.187597:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.187599:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.187699:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.187946:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.192793:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.193139:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.193169:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.193175:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.193182:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.193199:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.193210:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.193219:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.193239:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.194139:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.194149:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.194214:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.194220:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.194230:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.194248:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.194255:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b31606838c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.194279:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.194280:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.194282:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967115.197097:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.197112:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.197140:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.197145:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.197152:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.197179:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.197189:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.197197:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.197216:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967115.198060:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967115.198068:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.198088:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967115.198093:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.198102:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.198119:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.198126:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b316068393 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.198141:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.198143:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967115.198145:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.200268:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.200282:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.200300:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.200304:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.200310:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.200325:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.200342:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.200349:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.200488:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.200714:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.200722:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.200730:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.200734:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.200743:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.200792:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.201967:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b31606839a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.201992:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.201994:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.201997:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.203240:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.203252:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.203268:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.203273:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.203280:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.203295:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.203305:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.203313:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.203348:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.203683:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.203691:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.203700:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.203705:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.203714:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.203736:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.203744:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.204671:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.204674:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.204677:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.208095:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.208110:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.208129:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.208134:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.208142:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.208235:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.208248:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.208257:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.208284:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.208479:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.208487:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.208508:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.208513:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.208523:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.208542:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.208550:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b3160683a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.208969:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.208973:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.208975:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.209536:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.209545:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.209710:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.209722:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.209729:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.209740:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.209750:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.209756:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.210098:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.210106:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.210125:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.210129:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.210138:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.210152:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.210242:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783967115.210250:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b3160683af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.210465:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.210468:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.210470:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.212748:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.212789:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.213088:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.213094:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.213101:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.213117:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.213136:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.213143:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.213305:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.213457:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.213465:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.213473:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.213478:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.213487:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.213522:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.213537:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6cd4e0/0x9269c8b3160683b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.213960:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.213964:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.213965:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967115.215151:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967115.215222:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.215239:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=591s v=(0 0) 00010000:00010000:2.0:1783967115.215243:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967115.215250:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.215263:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.215273:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.215282:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967115.215317:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967115.215463:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967115.215470:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.215478:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967115.215483:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.215493:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.215517:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.215525:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c4ca69/0x9269c8b3160683bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.215544:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.215545:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.215547:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967115.216534:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.216545:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.216570:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.216582:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.216588:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.217114:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.217125:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.217133:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.217164:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967115.217323:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967115.217330:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.217339:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967115.217343:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.217352:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.217370:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.217378:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ec89e03/0x9269c8b3160683c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967115.217395:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.217397:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967115.217399:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967115.218040:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.218048:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218059:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.218063:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.218069:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218089:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218097:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218103:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218168:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783967115.218490:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.218505:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218513:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.218516:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.218520:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218528:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218535:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.218555:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218667:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967115.218674:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218682:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.218686:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218694:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218708:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218725:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad70aa5e/0x9269c8b3160683cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218742:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.218745:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218752:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.218755:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218764:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218793:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.218801:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.218803:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.218805:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.218878:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.218884:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9eaac9/0x9269c8b3160683d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783967115.219214:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.219219:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219228:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.219231:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.219235:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219244:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219252:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219259:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219333:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.219338:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219346:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.219354:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219361:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219372:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219379:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.219380:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.219382:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.219445:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.219450:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008024bdfa/0x9269c8b3160683d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783967115.219880:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.219887:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219896:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.219899:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.219903:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219912:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219920:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.219927:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219972:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.219978:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219985:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.219989:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.219997:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220009:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220018:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.220025:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.220027:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.220088:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.220093:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d933fe3b/0x9269c8b3160683e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783967115.220427:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.220432:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.220441:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.220444:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.220449:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.220458:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.220467:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.220474:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220514:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.220520:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220527:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.220531:0:17084:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220538:0:17084:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220550:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.220558:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.220560:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.220562:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.220678:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.220683:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025414799/0x9269c8b3160683e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783967115.220999:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.221005:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221024:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.221027:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.221031:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221041:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221048:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221056:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221100:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.221106:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221113:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.221117:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221124:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221141:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221149:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.221151:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.221152:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.221259:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.221264:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9b68850/0x9269c8b3160683ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783967115.221598:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967115.221605:0:19333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221613:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=591s v=(0 0) 00010000:00010000:3.0:1783967115.221616:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967115.221621:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221641:0:19333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221649:0:19333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967115.221657:0:19333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221751:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967115.221757:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221765:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967115.221789:0:17085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221798:0:17085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221811:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.221826:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.221827:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967115.221829:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967115.222231:0:19333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783967115.222237:0:19333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8eec12/0x9269c8b3160683f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967115.222293:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783967115.222753:0:19333:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:2.0:1783967115.223072:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17122:x1870624587981696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 82108us (82233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967115.223083:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967115.224898:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17122:1870624587981696:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783967115.224917:0:17122:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1783967115.224977:0:17122:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17122:1870624587982208:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1783967115.225030:0:17122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967115.225061:0:17122:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d163b180 going to sleep for 11 seconds 00000100:00100000:3.0:1783967115.226691:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982208 00000100:00100000:3.0:1783967115.226703:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982208 00000100:00100000:3.0:1783967115.226817:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783967115.226835:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17122:x1870624587982208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783967115.226884:0:18603:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1783967115.235222:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17122:x1870624587982208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8387us (10182us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783967115.235238:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783967115.235290:0:17122:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ec700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17122:1870624587982208:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783967115.235311:0:17122:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1783967115.639948:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967115.639981:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587982336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967115.640082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967115.640132:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982336 00000100:00100000:3.0:1783967115.640146:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982336 00000100:00100000:3.0:1783967115.640197:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783967115.640206:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587982336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967115.640243:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783967115.640296:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587982336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967115.640303:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783967115.640353:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587982336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967115.641509:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967115.641527:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587982464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967115.641601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967115.641795:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982464 00000100:00100000:1.0:1783967115.641802:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982464 00000100:00100000:1.0:1783967115.641857:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783967115.641865:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587982464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967115.641893:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967115.641940:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587982464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967115.641958:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783967115.641999:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587982464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783967115.838521:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967116.535727:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783967116.856119:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967117.879030:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967118.201586:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967118.204089:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587982592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783967118.204238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967118.204302:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982592 00000100:00100000:1.0:1783967118.204311:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982592 00000100:00100000:1.0:1783967118.204405:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967118.204416:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587982592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783967118.204463:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1783967118.204502:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967118.204516:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587982592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967118.204523:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967118.204537:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587982592:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1783967118.635282:0:19773:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783967118.905561:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783967119.551484:0:19825:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967119.551923:0:19825:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783967119.929514:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967120.247206:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587982720:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.247392:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587983232:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.247454:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587983744:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.247494:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587984256:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.247548:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783967120.247554:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587983104:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.247596:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587983616:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.247636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967120.247718:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587982976:0@lo:400:kworker.0 00000100:00100000:3.0:1783967120.249159:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982720 00000100:00100000:3.0:1783967120.249177:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982720 00000100:00100000:3.0:1783967120.249282:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783967120.249296:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:3646:x1870624587982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967120.249417:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:3646:x1870624587982720:12345-0@lo:400:kworker.0 Request processed in 124us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967120.249428:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783967120.250162:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983232 00000100:00100000:0.0:1783967120.250171:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983232 00000100:00100000:0.0:1783967120.250202:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983744 00000100:00100000:0.0:1783967120.250205:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983744 00000100:00100000:0.0:1783967120.250215:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984256 00000100:00100000:0.0:1783967120.250217:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984256 00000100:00100000:0.0:1783967120.250244:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783967120.250251:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587983232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250307:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624587983232:12345-0@lo:400:kworker.0 Request processed in 56us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.250314:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783967120.250328:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783967120.250333:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587983744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250364:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624587983744:12345-0@lo:400:kworker.0 Request processed in 30us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.250386:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783967120.250418:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967120.250426:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587984256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250461:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1870624587984256:12345-0@lo:400:kworker.0 Request processed in 37us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.250468:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967120.250496:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587982848:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.250595:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587983360:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.250634:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587983872:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.250673:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587984384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967120.250697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783967120.250737:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967120.250748:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982848 00000100:00100000:0.0:1783967120.250752:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982848 00000100:00100000:0.0:1783967120.250791:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983360 00000100:00100000:0.0:1783967120.250794:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983360 00000100:00100000:0.0:1783967120.250808:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783967120.250815:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587982848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250854:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587982848:12345-0@lo:400:kworker.0 Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.250860:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783967120.250871:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967120.250886:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587983360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250916:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587983360:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.250922:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967120.250960:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587982848:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250970:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587983360:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.250994:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983872 00000100:00100000:0.0:1783967120.250997:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983872 00000100:00100000:0.0:1783967120.251022:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783967120.251027:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587983872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.251057:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624587983872:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.251063:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1783967120.251076:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783967120.251094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4cae300 x1870624587983872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967120.251105:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624587983872:0@lo:400:kworker.0 00000100:00100000:3.0:1783967120.255008:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983104 00000100:00100000:3.0:1783967120.255022:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983104 00000100:00100000:3.0:1783967120.255112:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967120.255132:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587984512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967120.255321:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983616 00000100:00100000:2.0:1783967120.255326:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983616 00000100:00100000:2.0:1783967120.255457:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967120.255466:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587983616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.258971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.259030:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587983488:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.259108:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587984000:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967120.259183:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587982976 00000100:00100000:0.0:1783967120.259191:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587982976 00000100:00100000:0.0:1783967120.259229:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587983488 00000100:00100000:0.0:1783967120.259247:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587983488 00000100:00100000:0.0:1783967120.259268:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967120.259278:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587982976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259337:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587982976:12345-0@lo:400:kworker.0 Request processed in 60us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.259345:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967120.259364:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967120.259370:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587983488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259428:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587983488:12345-0@lo:400:kworker.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.259435:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783967120.259454:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967120.259458:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967120.259548:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984000 00000100:00100000:0.0:1783967120.259552:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984000 00000100:00100000:0.0:1783967120.259584:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967120.259590:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587984000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259625:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624587984000:12345-0@lo:400:kworker.0 Request processed in 35us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.259631:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1783967120.259645:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967120.259673:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587982976:0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.259684:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587983488:0@lo:400:kworker.0 00010000:00080000:0.0:1783967120.259695:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4cad180 x1870624587984000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967120.259706:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624587984000:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.260042:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984384 00000100:00100000:1.0:1783967120.260047:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984384 00000100:00100000:1.0:1783967120.260085:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967120.260092:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587984384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967120.260118:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967120.260155:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587984384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (9457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.260162:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967120.260596:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587984128:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.260639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.260669:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587982720:0@lo:400:kworker.0 00010000:00080000:1.0:1783967120.260683:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c2749500 x1870624587983232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967120.260695:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624587983232:0@lo:400:kworker.0 00010000:00080000:1.0:1783967120.260708:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4cafb80 x1870624587983744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967120.260730:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624587983744:0@lo:400:kworker.0 00010000:00080000:1.0:1783967120.260745:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4caea00 x1870624587984256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967120.260753:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624587984256:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.260800:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783967120.260809:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587984640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967120.260848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.260868:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984640 00000100:00100000:1.0:1783967120.260872:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984640 00000100:00100000:1.0:1783967120.260939:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967120.260947:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587984640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967120.260965:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967120.260995:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587984640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.261001:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967120.261041:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587984640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967120.261192:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984128 00000100:00100000:0.0:1783967120.261196:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984128 00000100:00100000:0.0:1783967120.261238:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967120.261243:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587984128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967120.261280:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587984128:12345-0@lo:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967120.261286:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783967120.266754:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783967120.266833:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f4caf800 x1870624587984128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967120.266850:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587984128:0@lo:400:kworker.0 00000100:00100000:3.0:1783967120.267035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967120.267100:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587984384:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1783967120.267143:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783967120.267200:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967120.267212:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587983104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967120.267277:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587983104:12345-0@lo:400:kworker.0 Request processed in 67us (19695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967120.267303:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967120.267344:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587983104:0@lo:400:kworker.0 00000100:00100000:1.0:1783967120.267417:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984512 00000100:00100000:1.0:1783967120.267424:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984512 00000100:00100000:1.0:1783967120.267461:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967120.267469:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587984512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967120.267485:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967120.267523:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624587984512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.267529:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967120.273699:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587984512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967120.279742:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587983616:12345-0@lo:400:kworker.0 Request processed in 24268us (32097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967120.279757:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783967120.279922:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587983616:0@lo:400:kworker.0 00000020:00000004:3.0:1783967120.666334:0:19875:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967120.666714:0:19875:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783967120.759966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783967120.759988:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587984768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967120.760080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.760127:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587984896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967120.760149:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967120.760179:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984768 00000100:00100000:1.0:1783967120.760186:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984768 00000100:00100000:1.0:1783967120.760240:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587984896 00000100:00100000:1.0:1783967120.760243:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587984896 00000100:00100000:1.0:1783967120.760259:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783967120.760267:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587984768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967120.760312:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967120.760361:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587984768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.760369:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783967120.760406:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783967120.760413:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587984896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967120.760444:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967120.760474:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587984896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.760481:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783967120.760548:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587984768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967120.760560:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587984896:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1783967120.764112:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1783967120.952626:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967120.998599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967120.998747:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563777920 00000100:00100000:1.0:1783967120.998759:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563777920 00000100:00100000:1.0:1783967120.998837:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:1.0:1783967120.998846:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1870624563777920:12345-192.168.204.59@tcp:250:mount.lustre.0 00010000:00080000:1.0:1783967120.998876:0:17091:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 419db461-1825-4e92-8b20-56544c55f6b4@192.168.204.59@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:1.0:1783967120.998905:0:17091:0:(genops.c:1406:class_connect()) connect: client 419db461-1825-4e92-8b20-56544c55f6b4, cookie 0x9269c8b3160683fc 00000100:00080000:1.0:1783967120.999069:0:17091:0:(import.c:65:import_set_state_nolock()) ffff9a05fd853800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967120.999150:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+5:2399:x1870624563777920:12345-192.168.204.59@tcp:250:mount.lustre.0 Request processed in 304us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967120.999158:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 118 00000100:00100000:0.0:1783967121.033293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.033454:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778048 00000100:00100000:3.0:1783967121.033466:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778048 00000100:00100000:3.0:1783967121.033545:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:3.0:1783967121.033556:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+5:14894:x1870624563778048:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783967121.033576:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967121.033594:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602178e00/0x9269c8b316068403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fdc expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.033623:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602178e00/0x9269c8b316068403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fdc expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.033635:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602178e00/0x9269c8b316068403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fdc expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.033644:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178e00, rc 0) 00000100:00100000:3.0:1783967121.033704:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+6:14894:x1870624563778048:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 149us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967121.033711:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:2.0:1783967121.044504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.045242:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778176 00000100:00100000:3.0:1783967121.045267:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778176 00000100:00100000:3.0:1783967121.045334:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:3.0:1783967121.045344:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+6:14894:x1870624563778176:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783967121.045570:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+6:14894:x1870624563778176:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 225us (1084us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783967121.045579:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:0.0:1783967121.049354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.049534:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778304 00000100:00100000:1.0:1783967121.049546:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778304 00000100:00100000:1.0:1783967121.049614:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:1.0:1783967121.049624:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+6:14894:x1870624563778304:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783967121.049643:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967121.049662:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63800/0x9269c8b31606840a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d6fe3 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.049693:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63800/0x9269c8b31606840a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fe3 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.049705:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63800/0x9269c8b31606840a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fe3 expref: 7 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.049714:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63800, rc 0) 00000100:00100000:1.0:1783967121.049802:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+7:14894:x1870624563778304:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.049809:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:3.0:1783967121.061617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.062421:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778432 00000100:00100000:1.0:1783967121.062433:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778432 00000100:00100000:1.0:1783967121.062513:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:1.0:1783967121.062522:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+7:14894:x1870624563778432:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783967121.062702:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+8:14894:x1870624563778432:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 181us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.062723:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:2.0:1783967121.066835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.066939:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778560 00000100:00100000:1.0:1783967121.066948:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778560 00000100:00100000:1.0:1783967121.067012:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1783967121.067023:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+8:14894:x1870624563778560:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783967121.067174:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+8:14894:x1870624563778560:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 151us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.067182:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:2.0:1783967121.071680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.074184:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778688 00000100:00100000:3.0:1783967121.074202:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778688 00000100:00100000:3.0:1783967121.074359:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:3.0:1783967121.074370:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778688:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967121.074556:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778688:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 186us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967121.074564:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1783967121.091525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.091673:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778816 00000100:00100000:3.0:1783967121.091686:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778816 00000100:00100000:3.0:1783967121.091759:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:3.0:1783967121.091804:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778816:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967121.092007:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778816:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 237us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967121.092016:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1783967121.104357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.104627:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563778944 00000100:00100000:3.0:1783967121.104637:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563778944 00000100:00100000:3.0:1783967121.104700:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:3.0:1783967121.104712:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778944:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967121.104927:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+8:14913:x1870624563778944:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 216us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967121.104936:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:2.0:1783967121.114698:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.114826:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779072 00000100:00100000:1.0:1783967121.114837:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779072 00000100:00100000:1.0:1783967121.114893:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:1.0:1783967121.114905:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+8:14894:x1870624563779072:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783967121.114922:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967121.114941:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d62600/0x9269c8b316068411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7014 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.114970:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d62600/0x9269c8b316068411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7014 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.114993:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d62600/0x9269c8b316068411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7014 expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967121.115002:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62600, rc 0) 00000100:00100000:1.0:1783967121.115070:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+9:14894:x1870624563779072:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.115077:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1783967121.124911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.125252:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779200 00000100:00100000:1.0:1783967121.125274:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779200 00000100:00100000:1.0:1783967121.125344:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:1.0:1783967121.125354:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+9:14894:x1870624563779200:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783967121.125380:0:17089:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783967121.125414:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783967121.125418:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783967121.125421:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783967121.125424:0:17089:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783967121.125426:0:17089:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783967121.127682:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+9:14894:x1870624563779200:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 2319us (2773us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.127697:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1783967121.134588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.134716:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779328 00000100:00100000:3.0:1783967121.134728:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779328 00000100:00100000:3.0:1783967121.134822:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:3.0:1783967121.134834:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+9:14894:x1870624563779328:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783967121.134851:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967121.134870:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d701b expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.134902:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.134914:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 10 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967121.134924:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179a00, rc 0) 00000100:00100000:3.0:1783967121.134990:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+10:14894:x1870624563779328:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 159us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967121.134998:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1783967121.140092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.140232:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779456 00000100:00100000:1.0:1783967121.140242:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779456 00000100:00100000:1.0:1783967121.140307:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:1.0:1783967121.140317:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+10:14894:x1870624563779456:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783967121.140496:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+10:14894:x1870624563779456:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 180us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.140504:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:2.0:1783967121.144814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.145106:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779584 00000100:00100000:1.0:1783967121.145118:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779584 00000100:00100000:1.0:1783967121.145174:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:1.0:1783967121.145183:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+10:14894:x1870624563779584:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783967121.146036:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+10:14894:x1870624563779584:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 849us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.146069:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:2.0:1783967121.154759:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.154836:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779712 00000100:00100000:3.0:1783967121.154845:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779712 00000100:00100000:1.0:1783967121.155019:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:1.0:1783967121.155032:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+10:14918:x1870624563779712:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967121.155167:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+10:14918:x1870624563779712:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 137us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.155175:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:2.0:1783967121.162749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.163418:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779840 00000100:00100000:1.0:1783967121.163427:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779840 00000100:00100000:1.0:1783967121.163653:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:1.0:1783967121.163664:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+10:14918:x1870624563779840:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967121.163982:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+10:14918:x1870624563779840:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 318us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.163990:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:2.0:1783967121.177884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967121.178000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967121.178451:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563779968 00000100:00100000:0.0:1783967121.178463:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563779968 00000100:00100000:0.0:1783967121.178520:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780224 00000100:00100000:0.0:1783967121.178524:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780224 00000100:00100000:0.0:1783967121.178542:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1783967121.178553:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1870624563779968:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783967121.178594:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1783967121.178654:0:17097:0:(genops.c:1406:class_connect()) connect: client 47e19328-a632-4b1f-8ff8-755b3236cab4, cookie 0x9269c8b31606841f 00000004:00100000:0.0:1783967121.178686:0:17097:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783967121.178963:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a10800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967121.179043:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2399:x1870624563779968:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 490us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.179065:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1783967121.179084:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1783967121.179089:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1870624563780224:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783967121.179122:0:17097:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1783967121.179151:0:17097:0:(genops.c:1406:class_connect()) connect: client 47e19328-a632-4b1f-8ff8-755b3236cab4, cookie 0x9269c8b316068426 00000004:00100000:0.0:1783967121.179166:0:17097:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783967121.182128:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967121.182302:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2399:x1870624563780224:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 3203us (4292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.182314:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1783967121.191674:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967121.191859:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.194235:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780480 00000100:00100000:1.0:1783967121.194251:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780480 00000100:00100000:1.0:1783967121.194348:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780096 00000100:00100000:1.0:1783967121.194353:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780096 00000100:00100000:1.0:1783967121.194374:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783967121.194395:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:14894:x1870624563780480:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967121.194446:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967121.194552:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:14894:x1870624563780480:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 168us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.194560:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783967121.194583:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1783967121.194609:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:0:x1870624563780096:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967121.194622:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967121.194660:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:0:x1870624563780096:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 52us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.194667:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00080000:2.0:1783967121.196035:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967121.197985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.198014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967121.203873:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780608 00000100:00100000:2.0:1783967121.203891:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780608 00000100:00100000:2.0:1783967121.204005:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780352 00000100:00100000:2.0:1783967121.204009:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780352 00000100:00080000:3.0:1783967121.204198:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967121.204285:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783967121.204298:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563780608:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783967121.204404:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563780608:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 109us (6427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.204411:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783967121.205525:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1783967121.205542:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:0:x1870624563780352:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783967121.205572:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967121.205742:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:0:x1870624563780352:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 204us (7725us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.205750:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:3.0:1783967121.215076:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967121.215199:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780992 00000100:00100000:1.0:1783967121.215211:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780992 00000100:00100000:1.0:1783967121.215283:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783967121.215293:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563780992:12345-192.168.204.59@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783967121.215377:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563780992:12345-192.168.204.59@tcp:900:mount.lustre.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.215393:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1783967121.217646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967121.217688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967121.217814:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780736 00000100:00100000:0.0:1783967121.217825:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780736 00000100:00100000:0.0:1783967121.217869:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563780864 00000100:00100000:0.0:1783967121.217872:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563780864 00000100:00100000:0.0:1783967121.217890:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967121.217898:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1870624563780736:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967121.217932:0:18603:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1783967121.217981:0:18603:0:(genops.c:1406:class_connect()) connect: client 47e19328-a632-4b1f-8ff8-755b3236cab4, cookie 0x9269c8b31606842d 00002000:00100000:0.0:1783967121.217994:0:18603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 47e19328-a632-4b1f-8ff8-755b3236cab4/ffff9a05e77e0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967121.218005:0:18603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783967121.218203:0:18603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783967121.218233:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967121.218316:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2399:x1870624563780736:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 417us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.218324:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967121.218343:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1783967121.218348:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1870624563780864:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967121.218367:0:18603:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp t0 exp 0000000000000000 cur 597 last 0 00000020:00000080:0.0:1783967121.218393:0:18603:0:(genops.c:1406:class_connect()) connect: client 47e19328-a632-4b1f-8ff8-755b3236cab4, cookie 0x9269c8b316068434 00002000:00100000:0.0:1783967121.218399:0:18603:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 47e19328-a632-4b1f-8ff8-755b3236cab4/ffff9a05e77e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967121.218405:0:18603:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783967121.218530:0:18603:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783967121.218546:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967121.218570:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2399:x1870624563780864:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 220us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967121.218577:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783967121.223102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967121.223410:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781120 00000100:00100000:0.0:1783967121.223421:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781120 00000100:00100000:0.0:1783967121.223483:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967121.223494:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563781120:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783967121.227766:0:17098:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4184us 00000004:00200000:1.0:1783967121.259447:0:17098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783967121.259591:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14894:x1870624563781120:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 36094us (36495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967121.259607:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967121.535945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967121.536107:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781248 00000100:00100000:2.0:1783967121.536120:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781248 00000100:00100000:2.0:1783967121.536198:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:2.0:1783967121.536209:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14941:x1870624563781248:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:2.0:1783967121.536234:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967121.536270:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031400/0x9269c8b31606843b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d704c expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536362:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536387:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536405:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967121.536469:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783967121.536474:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967121.536513:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536542:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031400/0x9269c8b31606843b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d704c expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536565:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d704c expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967121.536577:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:2.0:1783967121.536580:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783967121.536583:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0031200, rc 0) 00000100:00100000:2.0:1783967121.536925:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:14941:x1870624563781248:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 717us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967121.536933:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:0.0:1783967121.975096:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967123.001284:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967123.320590:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587985024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967123.320666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967123.320798:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985024 00000100:00100000:2.0:1783967123.320807:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985024 00000100:00100000:2.0:1783967123.320869:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783967123.320879:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587985024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967123.320915:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783967123.320965:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587985024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967123.320973:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783967123.321068:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587985024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783967123.321134:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967123.592222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.592516:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781376 00000100:00100000:1.0:1783967123.594552:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781376 00000100:00100000:1.0:1783967123.594985:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783967123.594997:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:14994:x1870624563781376:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:1.0:1783967123.595054:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967123.595409:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:14994:x1870624563781376:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 412us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.595417:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:3.0:1783967123.595629:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967123.604222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967123.604352:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781504 00000100:00100000:2.0:1783967123.604383:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781504 00000100:00100000:2.0:1783967123.604469:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783967123.604481:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781504:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:2.0:1783967123.604530:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967123.604634:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781504:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 153us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967123.604642:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:3.0:1783967123.605098:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967123.609911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.611284:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781632 00000100:00100000:1.0:1783967123.611432:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781632 00000100:00100000:1.0:1783967123.611520:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783967123.611532:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781632:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:1.0:1783967123.611562:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967123.611665:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781632:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 134us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.611674:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:3.0:1783967123.612262:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967123.624477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967123.625222:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781760 00000100:00100000:2.0:1783967123.625235:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781760 00000100:00100000:2.0:1783967123.625330:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783967123.625351:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781760:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:2.0:1783967123.625389:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1783967123.625438:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783967123.625513:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:47e19328-a632-4b1f-8ff8-755b3236cab4+6:14994:x1870624563781760:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 173us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967123.625521:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783967123.848192:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.854279:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563781888 00000100:00100000:1.0:1783967123.854298:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563781888 00000100:00100000:0.0:1783967123.854476:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:0.0:1783967123.854487:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+10:15026:x1870624563781888:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783967123.854504:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967123.854523:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1000/0x9269c8b316068449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7053 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.854551:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1000/0x9269c8b316068449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7053 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.854562:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1000/0x9269c8b316068449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7053 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.854571:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1000, rc 0) 00000100:00100000:0.0:1783967123.854647:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563781888:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 162us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.854654:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1783967123.878953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.879257:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782016 00000100:00100000:1.0:1783967123.879270:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782016 00000100:00100000:1.0:1783967123.879364:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:1.0:1783967123.879378:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563782016:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783967123.879616:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563782016:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 241us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.879625:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 135 00000100:00100000:2.0:1783967123.891718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.891989:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782144 00000100:00100000:1.0:1783967123.892011:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782144 00000100:00100000:1.0:1783967123.892101:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:1.0:1783967123.892113:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563782144:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783967123.892621:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563782144:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 506us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.892633:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:2.0:1783967123.899922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967123.900303:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782272 00000100:00100000:0.0:1783967123.900317:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782272 00000100:00100000:0.0:1783967123.900410:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:0.0:1783967123.900422:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782272:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783967123.900675:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782272:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 252us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.900691:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:3.0:1783967123.940443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.940719:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782400 00000100:00100000:1.0:1783967123.940741:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782400 00000100:00100000:1.0:1783967123.940856:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:1.0:1783967123.940869:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782400:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967123.941104:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782400:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 236us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.941114:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:2.0:1783967123.945868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967123.946127:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782528 00000100:00100000:3.0:1783967123.946142:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782528 00000100:00100000:3.0:1783967123.946235:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:3.0:1783967123.946249:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782528:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967123.946481:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+11:15033:x1870624563782528:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 233us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967123.946490:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:2.0:1783967123.949947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967123.952553:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782656 00000100:00100000:0.0:1783967123.952578:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782656 00000100:00100000:0.0:1783967123.952865:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:0.0:1783967123.952880:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+11:15026:x1870624563782656:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783967123.952907:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967123.952936:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0600/0x9269c8b316068450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7084 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.952979:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0600/0x9269c8b316068450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7084 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.952991:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0600/0x9269c8b316068450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7084 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.953351:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0600, rc 0) 00000100:00100000:0.0:1783967123.953462:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+12:15026:x1870624563782656:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 583us (3528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.953470:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:2.0:1783967123.958206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.958432:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782784 00000100:00100000:1.0:1783967123.958447:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782784 00000100:00100000:1.0:1783967123.958531:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:1.0:1783967123.958543:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+12:15026:x1870624563782784:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783967123.958584:0:17091:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783967123.958622:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783967123.958627:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783967123.958630:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783967123.958633:0:17091:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783967123.958635:0:17091:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1783967123.961552:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+12:15026:x1870624563782784:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 2991us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.961572:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:2.0:1783967123.964546:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967123.964749:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563782912 00000100:00100000:0.0:1783967123.964762:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563782912 00000100:00100000:0.0:1783967123.964903:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:0.0:1783967123.964915:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+12:15026:x1870624563782912:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783967123.964939:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967123.964964:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d708b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.965037:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.965052:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967123.965063:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783967123.965138:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:15026:x1870624563782912:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 225us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.965146:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:2.0:1783967123.968428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.968843:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783040 00000100:00100000:1.0:1783967123.968857:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783040 00000100:00100000:1.0:1783967123.968941:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:1.0:1783967123.968955:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:15026:x1870624563783040:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783967123.969204:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:15026:x1870624563783040:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 250us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.969835:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:2.0:1783967123.971570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967123.971695:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783168 00000100:00100000:0.0:1783967123.971707:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783168 00000100:00100000:0.0:1783967123.971861:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:0.0:1783967123.971874:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:15026:x1870624563783168:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783967123.972115:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:15026:x1870624563783168:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 243us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.972125:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:2.0:1783967123.975506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967123.975844:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783296 00000100:00100000:1.0:1783967123.975856:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783296 00000100:00100000:1.0:1783967123.975920:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:1.0:1783967123.975932:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:15037:x1870624563783296:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967123.976205:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:15037:x1870624563783296:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 275us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967123.976377:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:2.0:1783967123.979148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967123.979477:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783424 00000100:00100000:0.0:1783967123.979493:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783424 00000100:00100000:0.0:1783967123.979574:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:0.0:1783967123.979587:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:15037:x1870624563783424:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783967123.985531:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:15037:x1870624563783424:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 5927us (6381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967123.985552:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:2.0:1783967123.994688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967123.994840:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967124.000966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967124.004593:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783552 00000100:00100000:1.0:1783967124.004618:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783552 00000100:00100000:1.0:1783967124.004730:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783808 00000100:00100000:1.0:1783967124.004735:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783808 00000100:00100000:1.0:1783967124.004759:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1783967124.004783:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1870624563783552:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783967124.004827:0:17095:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 3b09368e-3456-41d0-9fd9-218c92aa494a@192.168.204.59@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:1.0:1783967124.004882:0:17095:0:(genops.c:1406:class_connect()) connect: client 3b09368e-3456-41d0-9fd9-218c92aa494a, cookie 0x9269c8b31606845e 00000004:00100000:1.0:1783967124.004918:0:17095:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1783967124.005410:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9a05fd853000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967124.005576:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2399:x1870624563783552:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 804us (10900us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.005586:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1783967124.005619:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:1.0:1783967124.005626:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1870624563783808:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783967124.005648:0:17095:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 3b09368e-3456-41d0-9fd9-218c92aa494a@192.168.204.59@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:1.0:1783967124.005680:0:17095:0:(genops.c:1406:class_connect()) connect: client 3b09368e-3456-41d0-9fd9-218c92aa494a, cookie 0x9269c8b316068465 00000004:00100000:1.0:1783967124.005699:0:17095:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:1.0:1783967124.005801:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9a05fd857000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967124.005829:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2399:x1870624563783808:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 202us (10989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.005836:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1783967124.006972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967124.007123:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784064 00000100:00100000:1.0:1783967124.007135:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784064 00000100:00100000:1.0:1783967124.007198:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1783967124.007210:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2403:x1870624563784064:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967124.007731:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2403:x1870624563784064:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 519us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.007742:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1783967124.007839:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784320 00000100:00100000:1.0:1783967124.007845:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784320 00000100:00100000:1.0:1783967124.007895:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783967124.007903:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784320:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967124.007938:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784320:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 36us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.007947:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1783967124.008154:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967124.008200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967124.008846:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784192 00000100:00100000:0.0:1783967124.008877:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784192 00000100:00100000:1.0:1783967124.010044:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784448 00000100:00100000:1.0:1783967124.010055:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784448 00000100:00100000:1.0:1783967124.010122:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1783967124.010134:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784448:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967124.010746:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:0.0:1783967124.010760:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784192:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967124.011108:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784448:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 974us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.011117:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:0.0:1783967124.022119:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563784192:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 11341us (13943us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967124.022143:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1783967124.029643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967124.029719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967124.029753:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783680 00000100:00100000:1.0:1783967124.029797:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783680 00010000:00010000:2.0:1783967124.029875:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967124.029943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00080000:0.0:1783967124.029981:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967124.030042:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784576 00000100:00100000:2.0:1783967124.030047:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784576 00000100:00100000:2.0:1783967124.030098:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563783936 00000100:00100000:2.0:1783967124.030102:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563783936 00000100:00100000:2.0:1783967124.030137:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1783967124.030150:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+7:15026:x1870624563784576:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783967124.030227:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783967124.030485:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+7:15026:x1870624563784576:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 337us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967124.030494:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:2.0:1783967124.030518:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1783967124.030527:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:0:x1870624563783936:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783967124.030620:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967124.030654:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:0:x1870624563783936:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 128us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967124.030661:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783967124.030907:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783967124.030928:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:0:x1870624563783680:12345-192.168.204.59@tcp:41:mount.lustre.0 00000100:00080000:0.0:1783967124.030936:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:1.0:1783967124.030945:0:17095:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967124.032756:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:0:x1870624563783680:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 1823us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967124.033373:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1783967124.042412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967124.048874:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784704 00000100:00100000:3.0:1783967124.048902:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784704 00000100:00100000:3.0:1783967124.049638:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1783967124.049658:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563784704:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783967124.050983:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563784704:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 1322us (8577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967124.050998:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967124.056994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967124.057040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967124.057089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967124.057161:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785088 00000100:00100000:2.0:1783967124.057175:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785088 00000100:00100000:2.0:1783967124.057280:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783967124.057294:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563785088:12345-192.168.204.59@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783967124.057447:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563785088:12345-192.168.204.59@tcp:900:mount.lustre.0 Request processed in 153us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967124.057457:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1783967124.062719:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784832 00000100:00100000:3.0:1783967124.062742:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784832 00000100:00100000:3.0:1783967124.062823:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563784960 00000100:00100000:3.0:1783967124.062827:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563784960 00000100:00100000:3.0:1783967124.062867:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783967124.062877:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1870624563784832:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783967124.062949:0:19333:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3b09368e-3456-41d0-9fd9-218c92aa494a@192.168.204.59@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:3.0:1783967124.062995:0:19333:0:(genops.c:1406:class_connect()) connect: client 3b09368e-3456-41d0-9fd9-218c92aa494a, cookie 0x9269c8b31606846c 00002000:00100000:3.0:1783967124.063012:0:19333:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3b09368e-3456-41d0-9fd9-218c92aa494a/ffff9a04c2492000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783967124.063028:0:19333:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:0.0:1783967124.063090:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00002000:00080000:3.0:1783967124.063153:0:19333:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1783967124.063169:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783967124.063177:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1870624563784960:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967124.063200:0:18601:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3b09368e-3456-41d0-9fd9-218c92aa494a@192.168.204.59@tcp t0 exp 0000000000000000 cur 600 last 0 00000100:00080000:3.0:1783967124.063220:0:19333:0:(import.c:65:import_set_state_nolock()) ffff9a04c2495800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1783967124.063223:0:18601:0:(genops.c:1406:class_connect()) connect: client 3b09368e-3456-41d0-9fd9-218c92aa494a, cookie 0x9269c8b316068473 00002000:00100000:0.0:1783967124.063232:0:18601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3b09368e-3456-41d0-9fd9-218c92aa494a/ffff9a05e77e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967124.063239:0:18601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783967124.063299:0:18601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1783967124.063317:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2399:x1870624563784832:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 439us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967124.063336:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783967124.063382:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785216 00000100:00100000:3.0:1783967124.063386:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785216 00000100:00100000:3.0:1783967124.063421:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1783967124.063428:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563785216:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783967124.063528:0:17099:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783967124.063586:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15026:x1870624563785216:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 157us (497us total) trans 0 rc 0/0 00000100:00080000:0.0:1783967124.063589:0:18601:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967124.063595:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1783967124.063624:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2399:x1870624563784960:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 445us (6534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967124.063641:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783967124.258030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967124.258384:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785344 00000100:00100000:1.0:1783967124.258398:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785344 00000100:00100000:1.0:1783967124.258489:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1783967124.258500:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15060:x1870624563785344:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:1.0:1783967124.258531:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967124.258572:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b31606847a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70bc expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967124.258673:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967124.258692:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967124.258707:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967124.259542:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783967124.259551:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967124.260871:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967124.260935:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b31606847a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967124.260974:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967124.261069:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:3.0:1783967124.261387:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967124.261393:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63400, rc 0) 00000100:00100000:3.0:1783967124.261577:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+7:15060:x1870624563785344:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 3074us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967124.261587:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:0.0:1783967125.047160:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967125.367089:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587985152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967125.367227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967125.368390:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783967125.368410:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587985280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967125.368498:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.368714:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985152 00000100:00100000:0.0:1783967125.368723:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985152 00000100:00100000:0.0:1783967125.368820:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985280 00000100:00100000:0.0:1783967125.368823:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985280 00000100:00100000:0.0:1783967125.368846:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967125.368856:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587985152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783967125.368896:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783967125.368958:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587985152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.368975:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967125.368997:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967125.369004:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587985280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783967125.369021:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967125.369053:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587985280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.369060:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783967125.369081:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783967125.369086:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967125.369143:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4caed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587985152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783967125.371360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985792:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371504:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587986304:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371550:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587986816:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371605:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783967125.371613:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783967125.371639:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371675:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985920:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371711:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587986432:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.371784:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985792 00000100:00100000:3.0:1783967125.371793:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985792 00000100:00100000:3.0:1783967125.371857:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985920 00000100:00100000:3.0:1783967125.371861:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985920 00000100:00100000:3.0:1783967125.371887:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967125.371907:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.371970:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985792:12345-0@lo:400:kworker.0 Request processed in 65us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.371978:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967125.371997:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967125.372003:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372032:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985920:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.372039:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967125.372061:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986304 00000100:00100000:3.0:1783967125.372065:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986304 00000100:00100000:3.0:1783967125.372085:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986816 00000100:00100000:3.0:1783967125.372087:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986816 00000100:00100000:3.0:1783967125.372099:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986432 00000100:00100000:3.0:1783967125.372101:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986432 00000100:00100000:3.0:1783967125.372115:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783967125.372122:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372153:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587986304:12345-0@lo:400:kworker.0 Request processed in 33us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.372159:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783967125.372171:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783967125.372177:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372218:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587986816:12345-0@lo:400:kworker.0 Request processed in 42us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.372225:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783967125.372236:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783967125.372242:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587986432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372278:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587986432:12345-0@lo:400:kworker.0 Request processed in 37us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.372285:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783967125.372353:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1783967125.372374:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985920:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372387:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587986432:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985792:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.372406:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587986304:0@lo:400:kworker.0 00010000:00080000:3.0:1783967125.372417:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57ab800 x1870624587986816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967125.372428:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587986816:0@lo:400:kworker.0 00000100:00080000:3.0:1783967125.372452:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967125.372456:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967125.372460:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967125.372462:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967125.372476:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985408 00000100:00100000:3.0:1783967125.372480:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985408 00000100:00100000:3.0:1783967125.372507:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967125.372512:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783967125.372529:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783967125.372565:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587985408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.372571:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967125.372604:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587985408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967125.373084:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f4cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587985280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967125.375670:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587985536:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.375802:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.375854:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587986048:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.375899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.375923:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587986560:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.375943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.375988:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783967125.375995:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587985664:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.376046:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587986176:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.376086:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587986688:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376118:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967125.376173:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986048 00000100:00100000:0.0:1783967125.376183:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986048 00000100:00100000:0.0:1783967125.376241:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986560 00000100:00100000:0.0:1783967125.376245:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986560 00000100:00100000:0.0:1783967125.376272:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986688 00000100:00100000:0.0:1783967125.376274:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986688 00000100:00100000:0.0:1783967125.376294:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967125.376313:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587986048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376379:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624587986048:12345-0@lo:400:kworker.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.376387:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967125.376405:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967125.376411:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587986560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376434:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587986560:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.376440:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967125.376458:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783967125.376463:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587986688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376490:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587986688:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.376496:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783967125.376514:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985664 00000100:00100000:0.0:1783967125.376517:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985664 00000100:00100000:0.0:1783967125.376536:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986176 00000100:00100000:0.0:1783967125.376538:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986176 00000100:00100000:0.0:1783967125.376550:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967125.376555:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587985664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376587:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587985664:12345-0@lo:400:kworker.0 Request processed in 31us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.376593:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967125.376604:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783967125.376609:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587986176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376653:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587986176:12345-0@lo:400:kworker.0 Request processed in 44us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967125.376659:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1783967125.376831:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967125.376836:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967125.376875:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587985664:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587986176:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376900:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587986688:0@lo:400:kworker.0 00000100:00100000:0.0:1783967125.376911:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624587986048:0@lo:400:kworker.0 00010000:00080000:0.0:1783967125.376939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f57a8e00 x1870624587986560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967125.376950:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587986560:0@lo:400:kworker.0 00000100:00100000:1.0:1783967125.377314:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587985536 00000100:00100000:1.0:1783967125.377320:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587985536 00000100:00100000:1.0:1783967125.377363:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783967125.377372:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587985536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967125.377426:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587985536:12345-0@lo:400:kworker.0 Request processed in 56us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967125.377433:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783967125.377480:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587985536:0@lo:400:kworker.0 00000100:00100000:3.0:1783967125.888998:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967125.889030:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587986944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967125.889123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.889177:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587987072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967125.889207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967125.889250:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587986944 00000100:00100000:3.0:1783967125.889260:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587986944 00000100:00100000:3.0:1783967125.889320:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987072 00000100:00100000:3.0:1783967125.889323:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987072 00000100:00100000:3.0:1783967125.889342:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783967125.889353:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587986944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783967125.889399:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783967125.889456:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587986944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.889463:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783967125.889481:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783967125.889487:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587987072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967125.889535:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783967125.889571:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587987072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967125.889578:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783967125.889645:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587987072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967125.889691:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587986944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783967126.072805:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967126.776145:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1783967126.910491:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:0.0:1783967126.910504:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00100000:1.0:1783967126.910881:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:1.0:1783967126.910899:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00100000:1.0:1783967126.910980:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:1.0:1783967126.910988:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00100000:1.0:1783967126.911434:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:1.0:1783967126.911443:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00010000:00010000:2.0:1783967127.095095:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783967127.757236:0:19973:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783967128.123222:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967128.440604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587987200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783967128.440702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783967128.441101:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967128.441323:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987200 00000100:00100000:2.0:1783967128.441335:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987200 00000100:00100000:2.0:1783967128.441432:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967128.441445:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587987200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967128.441486:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1783967128.441579:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967128.448472:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587987200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7011us (7751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967128.448498:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783967128.453418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587987200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783967129.143518:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967129.345407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.346998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.347015:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967129.347044:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785728 00000100:00100000:1.0:1783967129.347054:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785728 00000100:00100000:1.0:1783967129.347108:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786240 00000100:00100000:1.0:1783967129.347125:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786240 00000100:00100000:1.0:1783967129.347142:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785600 00000100:00100000:1.0:1783967129.347146:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785600 00000100:00100000:1.0:1783967129.347158:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786112 00000100:00100000:1.0:1783967129.347160:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786112 00000100:00100000:1.0:1783967129.347176:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1783967129.347185:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785728:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967129.347468:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785728:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 283us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967129.347476:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1783967129.347496:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783967129.347503:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786240:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967129.347530:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786240:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967129.347537:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:1.0:1783967129.347549:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1783967129.347555:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563785600:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967129.347590:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563785600:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967129.347596:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1783967129.347608:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:1.0:1783967129.347613:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563786112:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967129.347634:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563786112:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 21us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967129.347640:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:3.0:1783967129.349962:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785984 00000100:00100000:3.0:1783967129.349976:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785984 00000100:00100000:3.0:1783967129.350096:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786496 00000100:00100000:3.0:1783967129.350100:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786496 00000100:00100000:3.0:1783967129.350128:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785856 00000100:00100000:3.0:1783967129.350131:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785856 00000100:00100000:3.0:1783967129.350145:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786368 00000100:00100000:3.0:1783967129.350148:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786368 00000100:00100000:3.0:1783967129.350169:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783967129.350180:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785984:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967129.350468:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785984:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 288us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967129.350477:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783967129.350498:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783967129.350505:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786496:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967129.350533:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786496:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 29us (3589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967129.350539:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783967129.350551:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1783967129.350556:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785856:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967129.350578:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6b57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563785856:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 22us (3596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967129.350583:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1783967129.350728:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783967129.350957:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786368:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967129.350995:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563786368:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 260us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967129.351000:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00080000:3.0:1783967129.351035:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967129.351040:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967129.351042:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967129.351046:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967129.354004:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563785472 00000100:00100000:2.0:1783967129.354020:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563785472 00000100:00100000:1.0:1783967129.354568:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:1.0:1783967129.354580:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2403:x1870624563785472:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967129.358054:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2403:x1870624563785472:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 3462us (12643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967129.358071:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00010000:00010000:1.0:1783967130.167368:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967130.486976:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587987456:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.486977:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587987584:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.487091:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587987712:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.487606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967130.488112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587988096:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.488143:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967130.489762:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967130.489826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587988224:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.489856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.489933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.489968:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587987328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967130.489994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.490023:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587987968:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.490050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.490070:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587988480:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.490230:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.490252:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587988992:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.490293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.490335:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987456 00000100:00100000:0.0:1783967130.490337:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587988736:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.490343:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987456 00000100:00100000:0.0:1783967130.490359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.490394:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783967130.490403:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3645:x1870624587987456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967130.491004:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987584 00000100:00100000:3.0:1783967130.491010:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987584 00000100:00100000:3.0:1783967130.491039:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988096 00000100:00100000:3.0:1783967130.491043:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988096 00000100:00100000:3.0:1783967130.491056:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783967130.491063:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587987584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.493310:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3645:x1870624587987456:12345-0@lo:400:kworker.0 Request processed in 2896us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.493326:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783967130.493401:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987328 00000100:00100000:2.0:1783967130.493411:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987328 00000100:00100000:1.0:1783967130.493455:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587988608:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.493478:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967130.493489:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587987328:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967130.493511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967130.493526:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587989120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967130.493548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967130.493578:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587987840:0@lo:400:kworker.0 00002000:00000024:2.0:1783967130.493587:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967130.493625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.493653:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587987328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 165us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.493660:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967130.493671:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587989120 00000100:00100000:2.0:1783967130.493673:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587989120 00000100:00100000:2.0:1783967130.493690:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967130.493695:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587989120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783967130.493710:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783967130.493742:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587989120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.493748:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967130.493782:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987968 00000100:00100000:2.0:1783967130.493786:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987968 00000100:00100000:2.0:1783967130.493806:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988480 00000100:00100000:2.0:1783967130.493815:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988480 00000100:00100000:2.0:1783967130.493832:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988992 00000100:00100000:2.0:1783967130.493834:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988992 00000100:00100000:2.0:1783967130.493847:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988736 00000100:00100000:2.0:1783967130.493849:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988736 00000100:00100000:2.0:1783967130.493862:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988608 00000100:00100000:2.0:1783967130.493866:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988608 00000100:00100000:2.0:1783967130.493885:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783967130.493891:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587987968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.493925:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624587987968:12345-0@lo:400:kworker.0 Request processed in 34us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.493931:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783967130.493943:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967130.493948:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587988480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.493975:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624587988480:12345-0@lo:400:kworker.0 Request processed in 27us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.493980:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967130.493991:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783967130.493997:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587988992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494027:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624587988992:12345-0@lo:400:kworker.0 Request processed in 30us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.494033:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783967130.494044:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783967130.494049:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587988736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494078:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624587988736:12345-0@lo:400:kworker.0 Request processed in 29us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.494203:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783967130.494232:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783967130.494239:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587988608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494271:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624587988608:12345-0@lo:400:kworker.0 Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.494277:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1783967130.494304:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783967130.494307:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783967130.494310:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783967130.494312:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967130.494345:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624587987968:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494357:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624587988480:0@lo:400:kworker.0 00010000:00080000:2.0:1783967130.494371:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708700 x1870624587988992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967130.494381:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624587988992:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494391:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624587987456:0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494407:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587987328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967130.494491:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987712 00000100:00100000:2.0:1783967130.494496:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987712 00000100:00100000:2.0:1783967130.494604:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988224 00000100:00100000:2.0:1783967130.494608:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988224 00000100:00100000:2.0:1783967130.494620:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587987840 00000100:00100000:2.0:1783967130.494623:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587987840 00000100:00100000:2.0:1783967130.494849:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967130.494856:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587987712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494895:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587987712:12345-0@lo:400:kworker.0 Request processed in 40us (5139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.494908:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967130.494920:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967130.494926:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587988224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.494962:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587988224:12345-0@lo:400:kworker.0 Request processed in 35us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.494967:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967130.494976:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967130.494982:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587987840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.495007:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587987840:12345-0@lo:400:kworker.0 Request processed in 26us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.495012:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1783967130.495063:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783967130.495065:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783967130.496284:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56ad180 x1870624587988736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967130.496300:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624587988736:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.496333:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587989248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967130.496395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967130.496430:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587987712:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.496442:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587988224:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.496531:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624587988608:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.496725:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587989120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783967130.496905:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587989248 00000100:00100000:2.0:1783967130.496913:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587989248 00000100:00100000:2.0:1783967130.496960:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783967130.496968:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587989248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783967130.496991:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783967130.497035:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587989248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.497042:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783967130.497126:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587989248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967130.497505:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587987840:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.497514:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587988352:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.497542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967130.497566:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587988864:0@lo:400:kworker.0 00000100:00100000:1.0:1783967130.497588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967130.497677:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988352 00000100:00100000:2.0:1783967130.497683:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988352 00000100:00100000:2.0:1783967130.497727:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967130.497735:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587988352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.497793:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587988352:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.497806:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967130.497850:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587988864 00000100:00100000:0.0:1783967130.497859:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587988864 00000100:00100000:1.0:1783967130.497902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587988352:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.497908:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783967130.497918:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587988864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.497960:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624587988864:12345-0@lo:400:kworker.0 Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967130.497966:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967130.498017:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624587988864:0@lo:400:kworker.0 00000100:00080000:2.0:1783967130.498035:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967130.505855:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587987584:12345-0@lo:400:kworker.0 Request processed in 14782us (18239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.505872:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783967130.505909:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783967130.505920:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587988096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967130.505993:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587988096:12345-0@lo:400:kworker.0 Request processed in 77us (17849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967130.505999:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783967130.506231:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587988096:0@lo:400:kworker.0 00000100:00100000:0.0:1783967130.506246:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587987584:0@lo:400:kworker.0 00000100:00100000:1.0:1783967131.010539:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587989376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967131.010604:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967131.010656:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587989376 00000100:00100000:1.0:1783967131.010663:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587989376 00000100:00100000:1.0:1783967131.010702:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783967131.010709:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587989376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967131.010738:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783967131.010805:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587989376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.010812:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783967131.010847:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587989376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967131.011012:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587989504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967131.011041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967131.011078:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587989504 00000100:00100000:2.0:1783967131.011081:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587989504 00000100:00100000:2.0:1783967131.011098:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967131.011103:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587989504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967131.011121:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967131.011149:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587989504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967131.011155:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967131.011176:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587989504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783967131.191047:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783967131.311957:0:20121:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffed0e1d80 20000000:00000080:0.0:1783967131.311977:0:20121:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05e77a0000 uarg=0000000000000000 20000000:01000000:0.0:1783967131.312022:0:20121:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783967131.312027:0:20121:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783967131.312033:0:20121:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783967131.312607:0:20122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1783967131.312745:0:20121:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783967131.321869:0:20121:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783967131.322106:0:20121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322129:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068116 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322156:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068124 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322163:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068163 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322171:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322182:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322228:0:20121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322238:0:20121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322291:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322308:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 12 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322323:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989632:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967131.322435:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 12 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322443:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 12 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322461:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989760:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967131.322504:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322513:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 23 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322523:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989888:0@lo:104: 00000100:00100000:2.0:1783967131.322565:0:20121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783967131.322611:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322620:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 23 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322629:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990016:0@lo:104: 00000100:00100000:2.0:1783967131.322651:0:20121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783967131.322685:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322692:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 23 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322700:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990144:0@lo:104: 00000100:00100000:2.0:1783967131.322721:0:20121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783967131.322735:0:20121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 23 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.322754:0:20121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 23 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.322762:0:20121:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990272:0@lo:104: 00000100:00100000:2.0:1783967131.322802:0:20121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967131.322813:0:20121:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967131.322877:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587989888 00000100:00100000:1.0:1783967131.322885:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587989888 00000100:00100000:1.0:1783967131.322945:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990016 00000100:00100000:1.0:1783967131.322948:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990016 00000100:00100000:1.0:1783967131.322961:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990144 00000100:00100000:1.0:1783967131.322963:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990144 00000100:00100000:1.0:1783967131.322985:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990272 00000100:00100000:1.0:1783967131.322988:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990272 00000100:00100000:1.0:1783967131.323000:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967131.323008:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+6:20121:x1870624587989888:12345-0@lo:104: 00010000:00010000:1.0:1783967131.323021:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323089:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783967131.323095:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+6:20121:x1870624587989888:12345-0@lo:104: Request processed in 87us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.323102:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967131.323119:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967131.323124:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+5:20121:x1870624587990016:12345-0@lo:104: 00010000:00010000:1.0:1783967131.323133:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323140:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967131.323149:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323158:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967131.323162:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323169:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1783967131.323171:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.323177:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+5:20121:x1870624587990016:12345-0@lo:104: Request processed in 51us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.323185:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967131.323211:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 10000000:00010000:0.0:1783967131.323214:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.323221:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:20121:x1870624587990144:12345-0@lo:104: 10000000:01000000:0.0:1783967131.323224:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967131.323232:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323266:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323273:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967131.323276:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783967131.323283:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+4:20121:x1870624587990144:12345-0@lo:104: Request processed in 65us (561us total) trans 0 rc 0/0 00010000:00010000:0.0:1783967131.323297:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.323302:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783967131.323311:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b3160682c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160682c8 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.323319:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967131.323328:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:20121:x1870624587990272:12345-0@lo:104: 00010000:00010000:0.0:1783967131.323328:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967131.323334:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323340:0:17080:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323341:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967131.323347:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323357:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967131.323363:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967131.323368:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967131.323377:0:17080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783967131.323383:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3b28c549-2862-472c-a00b-4682deda9da4+3:20121:x1870624587990272:12345-0@lo:104: Request processed in 57us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.323388:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783967131.323392:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323399:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967131.323406:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967131.323412:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323419:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323420:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967131.323425:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323432:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068163 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606816a expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323435:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967131.323449:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323451:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1783967131.323457:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783967131.323458:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323468:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967131.323472:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323477:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323479:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323495:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1783967131.323497:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967131.323505:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967131.323514:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323523:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323524:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1e00/0x9269c8b316068124 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606812b expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.323540:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967131.323550:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967131.323550:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.323554:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967131.323557:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967131.323564:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967131.323570:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274ea00/0x9269c8b316068116 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606811d expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.323577:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587990528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967131.323585:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967131.323589:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967131.323592:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967131.323613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967131.323616:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587990400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967131.323650:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967131.323657:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967131.323661:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587990656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967131.323739:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989888:0@lo:104: 00000100:00100000:2.0:1783967131.323756:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990016:0@lo:104: 00000100:00100000:2.0:1783967131.323763:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990144:0@lo:104: 00000100:00100000:2.0:1783967131.323793:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587990272:0@lo:104: 00000100:00100000:2.0:1783967131.325208:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990528 00000100:00100000:2.0:1783967131.325220:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990528 00010000:00010000:2.0:1783967131.325259:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 24 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.325298:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990400 00000100:00100000:2.0:1783967131.325301:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990400 00010000:00010000:2.0:1783967131.325311:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 25 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.325328:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967131.325335:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+25:3647:x1870624587990528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967131.325349:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967131.325354:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 25 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.325363:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 25 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.325395:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630800/0x9269c8b31606816a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068163 expref: 25 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.325408:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967131.325476:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967131.325485:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b28c549-2862-472c-a00b-4682deda9da4+24:3646:x1870624587990400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967131.325493:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967131.325498:0:19433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 24 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967131.325505:0:19433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 24 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967131.325515:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0800/0x9269c8b3160682c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160682c1 expref: 24 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967131.325523:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967131.325799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967131.325858:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783967131.325867:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1783967131.326588:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990656 00000100:00100000:1.0:1783967131.326595:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990656 00010000:00010000:1.0:1783967131.326620:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 24 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967131.326643:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1783967131.326651:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967131.326658:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587990656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967131.326667:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967131.326672:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 24 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.326694:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 24 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.326713:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274e800/0x9269c8b31606812b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068124 expref: 24 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.326727:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967131.326793:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+23:3647:x1870624587990656:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.326801:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967131.326841:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587990656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967131.337140:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967131.337166:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587990784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967131.337258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967131.337536:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+22:3647:x1870624587990528:12345-0@lo:103:ldlm_bl.0 Request processed in 12198us (13921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967131.337548:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967131.337578:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990784 00000100:00100000:2.0:1783967131.337585:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990784 00010000:00010000:2.0:1783967131.337616:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 22 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.337663:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967131.337672:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+22:3646:x1870624587990784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967131.337689:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967131.337696:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 22 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.337707:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 22 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.337726:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1200/0x9269c8b31606811d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068116 expref: 22 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.337740:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967131.337796:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+21:3646:x1870624587990784:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967131.337801:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967131.337909:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587990784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967131.338065:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587990528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967131.338416:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3b28c549-2862-472c-a00b-4682deda9da4+20:3646:x1870624587990400:12345-0@lo:103:ldlm_bl.0 Request processed in 12931us (14761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967131.338425:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783967131.338547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967131.338946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967131.338976:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786752 00000100:00100000:0.0:1783967131.338981:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786752 00010000:00010000:0.0:1783967131.339009:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 13 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967131.339033:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786624 00000100:00100000:0.0:1783967131.339036:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786624 00010000:00010000:0.0:1783967131.339047:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 14 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967131.339064:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1783967131.339071:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+14:2401:x1870624563786752:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967131.339094:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967131.339099:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 14 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.339107:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 14 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967131.339201:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967131.339227:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783967131.339239:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419db461-1825-4e92-8b20-56544c55f6b4+14:2401:x1870624563786624:12345-192.168.204.59@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783967131.339245:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+14:2401:x1870624563786752:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 171us (697us total) trans 0 rc 0/0 00010000:00010000:1.0:1783967131.339252:0:20123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783967131.339255:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:1.0:1783967131.339262:0:20123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 14 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339276:0:20123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 13 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339292:0:20123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339301:0:20123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339320:0:20123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339339:0:20123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339346:0:20123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339352:0:20123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339359:0:20123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967131.339363:0:20123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339372:0:20123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339382:0:20123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967131.339392:0:20123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967131.339413:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:419db461-1825-4e92-8b20-56544c55f6b4+13:2401:x1870624563786624:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 177us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967131.339420:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1783967131.339498:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624587990400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967131.339902:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068457 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d708b expref: 12 pid: 17089 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.339917:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989632:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967131.339931:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602179a00/0x9269c8b316068418 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d701b expref: 11 pid: 17091 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967131.339941:0:20121:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20121:1870624587989760:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967131.339969:0:20121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.339978:0:20121:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.339984:0:20121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967131.339990:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030000/0x9269c8b316068488 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967132.215515:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967133.057091:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967133.057377:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563786880 00000100:00100000:2.0:1783967133.057393:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563786880 00000100:00100000:2.0:1783967133.057465:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:2.0:1783967133.057475:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+11:14909:x1870624563786880:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967133.057495:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967133.057515:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c0030200/0x9269c8b31606848f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70c3 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.057698:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c0030200/0x9269c8b31606848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70c3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.057710:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c0030200/0x9269c8b31606848f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70c3 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.057719:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030200, rc 0) 00000100:00100000:2.0:1783967133.057822:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563786880:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 348us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967133.057830:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1783967133.073756:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967133.074290:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787008 00000100:00100000:2.0:1783967133.074305:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787008 00000100:00100000:2.0:1783967133.074397:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:2.0:1783967133.074410:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563787008:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.074795:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563787008:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 386us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967133.074806:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 151 00000100:00100000:0.0:1783967133.087195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967133.089958:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787136 00000100:00100000:2.0:1783967133.089978:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787136 00000100:00100000:2.0:1783967133.090754:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:2.0:1783967133.090793:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563787136:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.091027:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563787136:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 253us (3840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967133.091037:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 152 00000100:00100000:0.0:1783967133.106849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967133.106907:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787264 00000100:00100000:0.0:1783967133.106920:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787264 00000100:00100000:0.0:1783967133.106994:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1783967133.107007:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+12:14909:x1870624563787264:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967133.107033:0:17091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967133.107067:0:17091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068496 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70ca expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.107108:0:17091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ca expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.107121:0:17091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ca expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.107147:0:17091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783967133.107237:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd21f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:14909:x1870624563787264:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 232us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967133.107246:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 153 00000100:00100000:0.0:1783967133.112166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967133.112293:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787392 00000100:00100000:1.0:1783967133.112307:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787392 00000100:00100000:1.0:1783967133.112385:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:1.0:1783967133.112396:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:14909:x1870624563787392:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.112943:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:14909:x1870624563787392:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 546us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.112954:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 154 00000100:00100000:1.0:1783967133.119184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967133.121070:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787520 00000100:00100000:3.0:1783967133.121093:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787520 00000100:00100000:3.0:1783967133.121202:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 155 00000100:00100000:3.0:1783967133.121217:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:14909:x1870624563787520:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967133.121498:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:14909:x1870624563787520:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 283us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967133.121509:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 155 00010000:00010000:1.0:1783967133.240742:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783967133.303605:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783967133.303616:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c1f6f800 from 13 10000000:01000000:1.0:1783967133.303625:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783967133.303694:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.303709:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.303724:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967133.303760:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587990912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.305046:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967133.305106:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d5fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.305483:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587990912 00000100:00100000:1.0:1783967133.305495:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587990912 00000100:00100000:1.0:1783967133.307627:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783967133.307649:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+20:17093:x1870624587990912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967133.307674:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967133.307700:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63200/0x9269c8b3160684a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b31606849d expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.307742:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63200/0x9269c8b3160684a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b31606849d expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.307803:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63200/0x9269c8b3160684a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b31606849d expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.307815:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63200, rc 0) 00000100:00100000:1.0:1783967133.310354:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587990912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2697us (5298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.310370:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783967133.310513:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587990912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967133.310565:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.310581:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967133.310728:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.310803:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967133.310851:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.310878:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991040 00000100:00100000:1.0:1783967133.310886:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991040 00000100:00100000:1.0:1783967133.313453:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783967133.313490:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587991040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.313738:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587991040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.313748:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783967133.313859:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.313963:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.314026:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967133.314063:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.314085:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991168 00000100:00100000:1.0:1783967133.314093:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991168 00000100:00100000:1.0:1783967133.316085:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783967133.316112:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587991168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.316417:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587991168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.316427:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783967133.323376:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783967133.346743:0:20195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783967133.347094:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783967133.347140:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783967133.347164:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.347179:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967133.347192:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783967133.347195:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f571a000 from 13 10000000:01000000:2.0:1783967133.347199:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783967133.347254:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.347262:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.347275:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967133.347312:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.347407:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967133.347469:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967133.347646:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991296 00000100:00100000:0.0:1783967133.347656:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991296 00000100:00100000:0.0:1783967133.347725:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783967133.347738:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+21:17093:x1870624587991296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967133.347755:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967133.347801:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0c00/0x9269c8b3160684b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160684ab expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.347833:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0c00/0x9269c8b3160684b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160684ab expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.347846:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0c00/0x9269c8b3160684b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160684ab expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.347857:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0c00, rc 0) 00000100:00100000:0.0:1783967133.347912:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967133.347920:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783967133.347990:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967133.348006:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.348033:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967133.348108:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967133.348262:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967133.348290:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d163bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.348448:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991424 00000100:00100000:1.0:1783967133.348453:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991424 00000100:00100000:1.0:1783967133.348492:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783967133.348500:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.348729:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.348738:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783967133.348821:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.348863:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.348917:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967133.349004:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ee08be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.349018:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991552 00000100:00100000:1.0:1783967133.349022:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991552 00000100:00100000:1.0:1783967133.349042:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783967133.349049:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.349313:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.349320:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783967133.349701:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783967133.351249:0:20197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783967133.354427:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783967133.354479:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783967133.354494:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.354509:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967133.354634:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783967133.354638:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c2f6c000 from 13 10000000:01000000:0.0:1783967133.354641:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967133.354687:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.354697:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967133.354709:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967133.354739:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967133.354908:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967133.355851:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d163b180 going to sleep for 11 seconds 00000100:00100000:2.0:1783967133.363289:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991680 00000100:00100000:2.0:1783967133.363310:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991680 00000100:00100000:3.0:1783967133.363510:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783967133.363534:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+22:17093:x1870624587991680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967133.363562:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967133.363592:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179e00/0x9269c8b3160684c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160684b9 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.363634:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179e00/0x9269c8b3160684c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160684b9 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.363649:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179e00/0x9269c8b3160684c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160684b9 expref: 23 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.363661:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179e00, rc 0) 00000100:00100000:3.0:1783967133.363817:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587991680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (8908us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967133.363824:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783967133.364205:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967133.364230:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.364253:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967133.364365:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.364405:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967133.364455:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.364502:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991808 00000100:00100000:1.0:1783967133.364509:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991808 00000100:00100000:1.0:1783967133.364558:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783967133.364566:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587991808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.364710:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587991808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.364718:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783967133.365177:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.365218:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783967133.365273:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967133.365309:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.365352:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587991936 00000100:00100000:1.0:1783967133.365356:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587991936 00000100:00100000:1.0:1783967133.365398:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783967133.365414:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587991936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.365515:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587991936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.365534:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783967133.366566:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587991936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783967133.367885:0:20200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783967133.372599:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783967133.372663:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783967133.372680:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967133.372695:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967133.376225:0:17093:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783967133.376238:0:17093:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05fcff7800 from 13 10000000:01000000:3.0:1783967133.376245:0:17093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967133.376307:0:17093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.376322:0:17093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.376337:0:17093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967133.376372:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967133.376725:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967133.376804:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657900 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.376926:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992064 00000100:00100000:1.0:1783967133.376947:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992064 00000100:00100000:1.0:1783967133.377021:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783967133.377033:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+23:17093:x1870624587992064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967133.377052:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967133.377068:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05c7d63e00/0x9269c8b3160684ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160684c7 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.377098:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05c7d63e00/0x9269c8b3160684ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160684c7 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.377127:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05c7d63e00/0x9269c8b3160684ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160684c7 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967133.377147:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63e00, rc 0) 00000100:00100000:1.0:1783967133.377215:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587992064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.377222:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783967133.377393:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967133.377419:0:17093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.377430:0:17093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967133.377507:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967133.377546:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967133.377571:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657900 going to sleep for 11 seconds 00000100:00100000:1.0:1783967133.377797:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992192 00000100:00100000:1.0:1783967133.377802:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992192 00000100:00100000:1.0:1783967133.378746:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783967133.378762:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587992192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967133.379159:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587992192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.379169:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783967133.382436:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967133.382648:0:17093:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967133.382849:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967133.382899:0:17093:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967133.383439:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992320 00000100:00100000:0.0:1783967133.383449:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992320 00000100:00100000:0.0:1783967133.383511:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783967133.383535:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587992320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967133.383702:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:17093:x1870624587992320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967133.383711:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783967133.384292:0:17093:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3b28c549-2862-472c-a00b-4682deda9da4:17093:1870624587992320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783967133.385412:0:20202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783967133.385628:0:17093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783967133.385660:0:17093:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967133.385674:0:17093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967133.385689:0:17093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967133.564397:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587992448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967133.564497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967133.565137:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992448 00000100:00100000:1.0:1783967133.565160:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992448 00000100:00100000:1.0:1783967133.565252:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967133.565266:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587992448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783967133.565309:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967133.565399:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587992448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967133.565408:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967133.565471:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587992448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783967133.565678:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783967134.268666:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967134.469655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967134.469720:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967134.469762:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.470004:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788160 00000100:00100000:2.0:1783967134.470028:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788160 00000100:00100000:2.0:1783967134.470117:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1783967134.470130:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563788160:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967134.470258:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563788160:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 129us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967134.470290:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967134.470756:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787904 00000100:00100000:0.0:1783967134.470764:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787904 00000100:00100000:0.0:1783967134.470855:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783967134.470866:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563787904:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967134.470917:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563787904:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 54us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967134.470924:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1783967134.473382:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787648 00000100:00100000:1.0:1783967134.473403:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787648 00000100:00100000:1.0:1783967134.473537:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:1.0:1783967134.473549:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2400:x1870624563787648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967134.473678:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2400:x1870624563787648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 130us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967134.473686:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00080000:3.0:1783967134.475487:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967134.475501:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783967134.479736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.479858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.479888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.479923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.479945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.479996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967134.480046:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788416 00000100:00100000:2.0:1783967134.480059:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788416 00000100:00100000:2.0:1783967134.480142:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563787776 00000100:00100000:2.0:1783967134.480146:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563787776 00000100:00100000:2.0:1783967134.480163:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788288 00000100:00100000:2.0:1783967134.480165:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788288 00000100:00100000:2.0:1783967134.480182:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1783967134.480192:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788416:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967134.480472:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788416:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 280us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967134.480534:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:2.0:1783967134.480555:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1783967134.480562:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2400:x1870624563787776:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967134.480588:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2400:x1870624563787776:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967134.480594:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:2.0:1783967134.480605:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783967134.480612:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2400:x1870624563788288:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967134.480659:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2400:x1870624563788288:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 47us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967134.480666:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783967134.480693:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788672 00000100:00100000:2.0:1783967134.480698:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788672 00000100:00100000:2.0:1783967134.480725:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788032 00000100:00100000:2.0:1783967134.480728:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788032 00000100:00100000:2.0:1783967134.480742:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788544 00000100:00100000:2.0:1783967134.480744:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788544 00000100:00100000:2.0:1783967134.480757:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1783967134.480762:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788672:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967134.480918:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967134.480929:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563788032:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967134.480963:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563788032:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 39us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967134.480970:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967134.480984:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783967134.480991:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788544:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967134.481028:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788544:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967134.481046:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1783967134.481999:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563788672:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1230us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967134.482011:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00080000:3.0:1783967134.482398:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967134.482404:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967134.482408:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967134.482411:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1783967135.287447:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967135.428058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.428224:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788800 00000100:00100000:3.0:1783967135.428233:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788800 00000100:00100000:3.0:1783967135.428299:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783967135.428310:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:15576:x1870624563788800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967135.428337:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967135.428371:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160684d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70d1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428433:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428447:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428461:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428475:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428482:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428489:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428566:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428575:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428582:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967135.428610:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967135.428614:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967135.428648:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428665:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428672:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428679:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428685:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.428689:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428696:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428709:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:3.0:1783967135.428712:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.428716:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428721:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b3160684dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428737:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428744:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428750:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428761:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.428764:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428839:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428849:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a04c3426300) 00010000:00010000:3.0:1783967135.428852:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.428855:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428861:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160684e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428894:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160684d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d1 expref: 8 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428908:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d1 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.428914:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c3426600) 00010000:00010000:3.0:1783967135.428916:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967135.428918:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179400, rc 0) 00000100:00100000:3.0:1783967135.428971:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15576:x1870624563788800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 664us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.428979:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967135.437059:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.437210:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563788928 00000100:00100000:2.0:1783967135.437220:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563788928 00000100:00100000:2.0:1783967135.437272:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1783967135.437282:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15576:x1870624563788928:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783967135.437377:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15576:x1870624563788928:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.437385:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1783967135.440206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967135.440296:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789184 00000100:00100000:1.0:1783967135.440304:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789184 00000100:00100000:1.0:1783967135.440373:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1783967135.440383:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15576:x1870624563789184:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967135.440401:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967135.440421:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b3160684f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70d8 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440503:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440518:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440528:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440591:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440599:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440606:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440731:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63000/0x9269c8b316068506 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440740:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63000/0x9269c8b316068506 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.440747:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63000/0x9269c8b316068506 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967135.440756:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783967135.441212:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441220:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441227:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441232:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967135.441236:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441243:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441254:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c3426600) 00010000:00010000:1.0:1783967135.441257:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967135.441260:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441275:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b3160684f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441289:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441295:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441301:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441306:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967135.441309:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441314:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441321:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a05f1a82a00) 00010000:00010000:1.0:1783967135.441333:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967135.441337:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.441342:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b3160684ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.442394:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b3160684f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d8 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.442428:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63000/0x9269c8b316068506 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d8 expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.442436:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05f1a82300) 00010000:00010000:1.0:1783967135.442439:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967135.442441:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d63000, rc 0) 00000100:00100000:1.0:1783967135.442584:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15576:x1870624563789184:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 2201us (2384us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783967135.442593:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1783967135.451276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.451422:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789312 00000100:00100000:0.0:1783967135.451435:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789312 00000100:00100000:0.0:1783967135.451508:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1783967135.451521:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15576:x1870624563789312:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783967135.451677:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15576:x1870624563789312:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 158us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.451686:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:2.0:1783967135.457205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967135.457375:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789440 00000100:00100000:1.0:1783967135.457388:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789440 00000100:00100000:1.0:1783967135.457462:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1783967135.457473:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15576:x1870624563789440:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1783967135.461615:0:17097:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4088us 00000100:00100000:1.0:1783967135.500076:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15576:x1870624563789440:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 42586us (42866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967135.500094:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1783967135.530557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.530884:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789568 00000100:00100000:3.0:1783967135.530917:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789568 00000100:00100000:3.0:1783967135.531100:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783967135.531121:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15582:x1870624563789568:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967135.531150:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967135.531178:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316068514 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70df expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531264:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531283:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531298:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531315:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531322:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531329:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531383:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531390:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531397:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531411:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.531417:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531425:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531442:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:3.0:1783967135.531445:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.531449:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531454:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b31606851b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531470:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531476:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531481:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531486:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.531488:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531494:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531511:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a04c3426300) 00010000:00010000:3.0:1783967135.531514:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.531517:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531522:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068522 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531560:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316068514 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70df expref: 10 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531571:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:3.0:1783967135.531573:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.531577:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b316068514 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70df expref: 10 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.531587:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179000, rc 0) 00000100:00100000:3.0:1783967135.532043:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15582:x1870624563789568:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 930us (1499us total) trans 0 rc 301/301 00000100:00100000:3.0:1783967135.532052:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:1.0:1783967135.536586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.536709:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789696 00000100:00100000:0.0:1783967135.536722:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789696 00000100:00100000:0.0:1783967135.536820:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967135.536833:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15582:x1870624563789696:12345-192.168.204.59@tcp:700:lfs.0 00000100:00100000:0.0:1783967135.536947:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15582:x1870624563789696:12345-192.168.204.59@tcp:700:lfs.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.536956:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1783967135.542541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967135.542755:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563789952 00000100:00100000:1.0:1783967135.543159:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563789952 00000100:00100000:1.0:1783967135.543291:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1783967135.543304:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+9:15582:x1870624563789952:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:1.0:1783967135.543412:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967135.543451:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b316068442 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d704c expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.543477:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:1.0:1783967135.543483:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783967135.543585:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.543603:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.543613:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.543659:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.543676:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 5 pid: 17095 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967135.543692:0:17097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17097:1870624587992576:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967135.543872:0:17097:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3768300 going to sleep for 11 seconds 00000100:00100000:0.0:1783967135.549058:0:17097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1cf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17097:1870624587992576:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783967135.549101:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967135.555456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.555577:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790080 00000100:00100000:3.0:1783967135.555590:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790080 00010000:00010000:3.0:1783967135.555651:0:17083:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 6 pid: 17095 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967135.555708:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:3.0:1783967135.555720:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2400:x1870624563790080:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967135.555762:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967135.555941:0:17083:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 6 pid: 17095 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.555958:0:17083:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 6 pid: 17095 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.555992:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b316068481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70bc expref: 6 pid: 17095 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.556018:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:3.0:1783967135.556025:0:17083:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.556036:0:17083:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.556045:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.556091:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967135.556180:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563790080:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 461us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.556190:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:1.0:1783967135.556271:0:17097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.556281:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.556328:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.556341:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.556351:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559653:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559679:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559693:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783967135.559842:0:17097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0498b00 reply state 0000000022f81e71 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559857:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559866:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:1.0:1783967135.559873:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967135.559879:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783967135.559886:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783967135.559896:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559902:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559923:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559929:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967135.559934:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559942:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559955:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c1ccab00) 00010000:00010000:1.0:1783967135.559957:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967135.559962:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.559969:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b316068529 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783967135.560053:0:17097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a0498b00 reply state 0000000022f81e71 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.560065:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967135.560070:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a05f1a82a00) 00010000:00010000:1.0:1783967135.560072:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967135.560074:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783967135.560258:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+10:15582:x1870624563789952:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 16952us (17729us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783967135.560267:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783967135.607093:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587992704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967135.607217:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587992832:0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.607237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967135.607313:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587993344:0@lo:400:kworker.0 00000100:00100000:2.0:1783967135.607470:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992704 00000100:00100000:2.0:1783967135.607493:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992704 00000100:00100000:2.0:1783967135.607550:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783967135.607562:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587992704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783967135.607597:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000040:00080000:1.0:1783967135.608818:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783967135.612072:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587992960:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.612973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613031:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587993216:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613133:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587993728:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613387:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587994240:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613464:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587993088:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587993600:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613548:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587994112:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613582:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587994624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967135.613602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967135.613632:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993216 00000100:00100000:0.0:1783967135.613639:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993216 00000100:00100000:0.0:1783967135.613684:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993728 00000100:00100000:0.0:1783967135.613686:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993728 00000100:00100000:0.0:1783967135.613697:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993088 00000100:00100000:0.0:1783967135.613699:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993088 00000100:00100000:0.0:1783967135.613840:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993600 00000100:00100000:0.0:1783967135.613843:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993600 00000100:00100000:0.0:1783967135.613860:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967135.613869:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587993216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.613925:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587993216:12345-0@lo:400:kworker.0 Request processed in 56us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.613934:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967135.613958:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967135.613965:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587993728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.614029:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624587993728:12345-0@lo:400:kworker.0 Request processed in 64us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.614036:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967135.614047:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967135.614053:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587993088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.614084:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587993088:12345-0@lo:400:kworker.0 Request processed in 31us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.614090:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967135.614901:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783967135.614915:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.614959:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587993600:12345-0@lo:400:kworker.0 Request processed in 50us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.614965:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783967135.615010:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587993088:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615021:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587993600:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615049:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783967135.615057:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1783967135.615319:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587993216:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615331:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587993728:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615355:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994240 00000100:00100000:0.0:1783967135.615361:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994240 00000100:00100000:0.0:1783967135.615398:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994112 00000100:00100000:0.0:1783967135.615401:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994112 00000100:00100000:0.0:1783967135.615433:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783967135.615440:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587994240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615480:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624587994240:12345-0@lo:400:kworker.0 Request processed in 41us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.615486:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783967135.615499:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783967135.615505:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587994112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615537:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587994112:12345-0@lo:400:kworker.0 Request processed in 33us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.615543:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1783967135.615570:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708700 x1870624587994112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967135.615582:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587994112:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615604:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624587994240:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615635:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994624 00000100:00100000:0.0:1783967135.615639:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994624 00000100:00100000:0.0:1783967135.615743:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967135.615750:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587994624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783967135.615806:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783967135.615840:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587994624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.615846:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967135.615872:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587994624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967135.615910:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992832 00000100:00100000:0.0:1783967135.615914:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992832 00000100:00100000:0.0:1783967135.615953:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783967135.615959:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587992832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.615991:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587992832:12345-0@lo:400:kworker.0 Request processed in 33us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.615997:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783967135.616031:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587992832:0@lo:400:kworker.0 00000100:00080000:0.0:1783967135.616075:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967135.616080:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967135.616082:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967135.616084:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783967135.616242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967135.616518:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587993856:0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.616563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967135.616605:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993344 00000100:00100000:3.0:1783967135.616612:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993344 00000100:00100000:3.0:1783967135.616659:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993856 00000100:00100000:3.0:1783967135.616661:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993856 00000100:00100000:3.0:1783967135.616675:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783967135.616683:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587993344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.616733:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587993344:12345-0@lo:400:kworker.0 Request processed in 50us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.616741:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783967135.616758:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783967135.616764:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.616960:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587993856:12345-0@lo:400:kworker.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.616968:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783967135.617010:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587993856:0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.617019:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587994368:0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.617043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967135.617069:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994368 00000100:00100000:3.0:1783967135.617074:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994368 00000100:00080000:3.0:1783967135.617102:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783967135.617145:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783967135.617152:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587994368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.617181:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587994368:12345-0@lo:400:kworker.0 Request processed in 30us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.617199:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1783967135.617228:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05cf065f80 x1870624587994368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967135.617239:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587994368:0@lo:400:kworker.0 00000100:00100000:3.0:1783967135.617275:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587993344:0@lo:400:kworker.0 00000100:00100000:2.0:1783967135.620047:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587992704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12476us (12801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.620064:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783967135.620418:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587992704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967135.620559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967135.620638:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587993472:0@lo:400:kworker.0 00000100:00100000:1.0:1783967135.620677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967135.620940:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587993984:0@lo:400:kworker.0 00000100:00100000:1.0:1783967135.620968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967135.620991:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587994496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967135.621015:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967135.621038:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994496 00000100:00100000:1.0:1783967135.621043:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994496 00000100:00100000:1.0:1783967135.621084:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967135.621092:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587994496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967135.621133:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967135.621170:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587994496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.621304:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587994496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967135.621338:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993984 00000100:00100000:0.0:1783967135.621341:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993984 00000100:00100000:0.0:1783967135.621377:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783967135.621382:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587993984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.621436:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624587993984:12345-0@lo:400:kworker.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.621443:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783967135.621473:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624587993984:0@lo:400:kworker.0 00000100:00100000:1.0:1783967135.621994:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783967135.622075:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587992960 00000100:00100000:2.0:1783967135.622081:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587992960 00000100:00100000:2.0:1783967135.622246:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587993472 00000100:00100000:2.0:1783967135.622251:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587993472 00000100:00100000:2.0:1783967135.622269:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783967135.622277:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587992960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967135.622376:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587992960:12345-0@lo:400:kworker.0 Request processed in 100us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.622383:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783967135.622397:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783967135.622415:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587993472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967135.622449:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587993472:12345-0@lo:400:kworker.0 Request processed in 46us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.622455:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1783967135.622481:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967135.622976:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587992960:0@lo:400:kworker.0 00000100:00100000:0.0:1783967135.622988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587993472:0@lo:400:kworker.0 00000100:00100000:2.0:1783967135.689588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.689692:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790208 00000100:00100000:0.0:1783967135.689702:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790208 00000100:00100000:0.0:1783967135.689812:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1783967135.689823:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+10:15590:x1870624563790208:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:0.0:1783967135.689862:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967135.689891:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606853e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70e6 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.689957:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.689983:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.689997:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967135.690046:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783967135.690050:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783967135.690083:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.690117:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606853e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70e6 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.690137:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70e6 expref: 11 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.690150:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:0.0:1783967135.690153:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783967135.690157:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0200, rc 0) 00000100:00100000:0.0:1783967135.690218:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+11:15590:x1870624563790208:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 397us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.690226:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:1.0:1783967135.748350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.748446:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790336 00000100:00100000:2.0:1783967135.748458:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790336 00000100:00100000:2.0:1783967135.748521:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1783967135.748532:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:15591:x1870624563790336:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783967135.748568:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967135.748589:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b31606854c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70ed expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748659:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748673:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748684:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967135.748729:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783967135.748743:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967135.748797:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748824:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b31606854c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ed expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748844:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ed expref: 6 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.748852:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:2.0:1783967135.748854:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783967135.748857:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030800, rc 0) 00000100:00100000:2.0:1783967135.748924:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15591:x1870624563790336:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 394us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.748931:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1783967135.761373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.761503:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790464 00000100:00100000:3.0:1783967135.761513:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790464 00000100:00100000:3.0:1783967135.761577:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783967135.761587:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:15591:x1870624563790464:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967135.761608:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967135.761643:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b31606855a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70f4 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.761722:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.761923:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.761937:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.761950:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.761958:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762001:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762080:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762090:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762096:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967135.762144:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967135.762148:0:17097:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967135.762171:0:17097:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762184:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762190:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762196:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762202:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.762206:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762213:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762233:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:3.0:1783967135.762236:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.762239:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762244:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762259:0:17097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762265:0:17097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762269:0:17097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762274:0:17097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967135.762277:0:17097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762283:0:17097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762290:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a05f1a82a00) 00010000:00010000:3.0:1783967135.762292:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967135.762295:0:17097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762300:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068568 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762338:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b31606855a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70f4 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762352:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70f4 expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967135.762359:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:3.0:1783967135.762361:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967135.762364:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178400, rc 0) 00000100:00100000:3.0:1783967135.762432:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+7:15591:x1870624563790464:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 845us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.762440:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783967135.765521:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.765826:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790592 00000100:00100000:2.0:1783967135.765841:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790592 00000100:00100000:2.0:1783967135.765992:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1783967135.766006:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:15591:x1870624563790592:12345-192.168.204.59@tcp:900:lfs.0 00000100:00100000:2.0:1783967135.766133:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:15591:x1870624563790592:12345-192.168.204.59@tcp:900:lfs.0 Request processed in 130us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.766141:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1783967135.792686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.793281:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563790848 00000100:00100000:0.0:1783967135.793292:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563790848 00000100:00100000:0.0:1783967135.793366:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1783967135.793376:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+7:15591:x1870624563790848:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783967135.793398:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967135.793419:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d70fb expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967135.793713:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783967135.793848:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068576 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70fb expref: 9 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.793864:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:0.0:1783967135.793868:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783967135.793873:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70fb expref: 9 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.793887:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:0.0:1783967135.794059:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+8:15591:x1870624563790848:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 683us (1382us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783967135.794067:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:1.0:1783967135.800539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.800956:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563791104 00000100:00100000:2.0:1783967135.800966:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563791104 00000100:00100000:2.0:1783967135.801030:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1783967135.801040:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+8:15591:x1870624563791104:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:2.0:1783967135.801094:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967135.801130:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b31606856f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70f4 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.801149:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967135.801153:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783967135.801177:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.801195:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.801206:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783967135.801613:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000050ba668 reply state 000000004baabb54 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.801644:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.801650:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967135.801653:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783967135.801655:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783967135.801664:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783967135.803105:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+9:15591:x1870624563791104:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 2058us (2568us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783967135.803128:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:3.0:1783967135.813809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.813878:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563791360 00000100:00100000:0.0:1783967135.813888:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563791360 00000100:00100000:0.0:1783967135.813941:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:0.0:1783967135.813951:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+9:15591:x1870624563791360:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783967135.814187:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+10:15591:x1870624563791360:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 236us (420us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783967135.814212:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1783967135.832213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.832328:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563791616 00000100:00100000:0.0:1783967135.832339:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563791616 00000100:00100000:0.0:1783967135.832404:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:0.0:1783967135.832415:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+10:15591:x1870624563791616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783967135.832442:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967135.832463:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606858b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7102 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832540:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832556:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832566:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832576:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832582:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832588:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967135.832696:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783967135.832944:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832973:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832981:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.832987:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967135.832992:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833001:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833014:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:0.0:1783967135.833017:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967135.833022:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833231:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b316068592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833248:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833253:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833260:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833265:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967135.833275:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833282:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833291:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a05f1a82a00) 00010000:00010000:0.0:1783967135.833293:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967135.833297:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833303:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833356:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606858b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7102 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833366:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:0.0:1783967135.833368:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783967135.833371:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606858b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7102 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.833380:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:0.0:1783967135.835907:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+11:15591:x1870624563791616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 3480us (3691us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783967135.835920:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1783967135.843055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.843466:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563791744 00000100:00100000:2.0:1783967135.843549:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563791744 00000100:00100000:2.0:1783967135.843725:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1783967135.843737:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+11:15591:x1870624563791744:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:2.0:1783967135.843763:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967135.843813:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b3160685a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7109 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.843907:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.843922:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.843932:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967135.843954:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783967135.843958:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967135.844007:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.844033:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b3160685a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 13 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.844051:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.844059:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967135.844062:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783967135.844066:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0031000, rc 0) 00000100:00100000:2.0:1783967135.844139:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+12:15591:x1870624563791744:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 405us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967135.844147:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1783967135.850222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.850397:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563791872 00000100:00100000:0.0:1783967135.850406:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563791872 00000100:00100000:0.0:1783967135.850469:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1783967135.850557:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+12:15591:x1870624563791872:12345-192.168.204.59@tcp:37:lfs.0 00000100:00100000:0.0:1783967135.858546:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+12:15591:x1870624563791872:12345-192.168.204.59@tcp:37:lfs.0 Request processed in 7982us (8322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.858561:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783967135.868969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.873762:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792128 00000100:00100000:3.0:1783967135.873793:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792128 00000100:00100000:3.0:1783967135.873857:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1783967135.873875:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed252050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+12:15591:x1870624563792128:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783967135.874120:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed252050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+13:15591:x1870624563792128:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 247us (5160us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783967135.874129:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783967135.972684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967135.972936:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792256 00000100:00100000:0.0:1783967135.972946:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792256 00000100:00100000:0.0:1783967135.973017:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:0.0:1783967135.973027:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+11:15597:x1870624563792256:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967135.973045:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967135.973064:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b3160685b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7110 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973142:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973157:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973168:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973179:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973186:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973194:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973269:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973292:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973300:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967135.973336:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783967135.973339:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783967135.973374:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973386:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973394:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973401:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973407:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967135.973411:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973419:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973431:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:0.0:1783967135.973434:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967135.973439:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973456:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b3160685bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973470:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973612:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973618:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973623:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967135.973626:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973763:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973900:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a05f1a82a00) 00010000:00010000:0.0:1783967135.973903:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967135.973907:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973913:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973945:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b3160685b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7110 expref: 13 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973971:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7110 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967135.973979:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:0.0:1783967135.973982:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783967135.973996:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0400, rc 0) 00000100:00100000:0.0:1783967135.974056:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+12:15597:x1870624563792256:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1030us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967135.974063:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783967135.983960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967135.984096:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792384 00000100:00100000:3.0:1783967135.984115:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792384 00000100:00100000:3.0:1783967135.984182:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1783967135.984192:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15597:x1870624563792384:12345-192.168.204.59@tcp:900:bash.0 00000100:00100000:3.0:1783967135.984292:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15597:x1870624563792384:12345-192.168.204.59@tcp:900:bash.0 Request processed in 100us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967135.984301:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000040:00080000:1.0:1783967135.993803:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783967135.997372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967135.998914:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792640 00000100:00100000:2.0:1783967135.998928:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792640 00000100:00100000:2.0:1783967135.999081:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:2.0:1783967135.999094:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+12:15597:x1870624563792640:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783967135.999125:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967135.999150:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b3160685d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7117 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.999269:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.999285:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.999306:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.999343:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 12 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967135.999356:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 12 pid: 17095 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967135.999369:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587994752:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783967135.999459:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967136.005898:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587994752:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967136.005931:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967136.007435:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967136.007811:0:20123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792768 00000100:00100000:2.0:1783967136.007820:0:20123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792768 00010000:00010000:2.0:1783967136.007873:0:20123:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 13 pid: 17095 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967136.007914:0:20123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:2.0:1783967136.007925:0:20123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b09368e-3456-41d0-9fd9-218c92aa494a+13:2401:x1870624563792768:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967136.007940:0:20123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967136.007948:0:20123:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 13 pid: 17095 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.007984:0:20123:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 13 pid: 17095 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.008007:0:20123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b3160685ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7109 expref: 13 pid: 17095 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.008024:0:20123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967136.008029:0:20123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.008040:0:20123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.008047:0:20123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967136.008082:0:20123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967136.008147:0:20123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3b09368e-3456-41d0-9fd9-218c92aa494a+12:2401:x1870624563792768:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 223us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967136.008165:0:20123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00010000:00010000:1.0:1783967136.008424:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.008433:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.008456:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.008466:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.008474:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783967136.008553:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783967136.009568:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.009583:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.009591:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967136.009602:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783967136.010845:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010858:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010864:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010885:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967136.010889:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010896:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010911:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:1.0:1783967136.010914:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967136.010918:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010924:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031200/0x9269c8b3160685d8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783967136.010941:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f71cfea6 reply state 0000000042f15e0e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010954:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.010960:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a05f1a82800) 00010000:00010000:1.0:1783967136.010963:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967136.010965:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783967136.011010:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b3160685d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.011026:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 14 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.011044:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.011046:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783967136.011049:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62c00, rc 0) 00000100:00100000:1.0:1783967136.011130:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+15:15597:x1870624563792640:12345-192.168.204.59@tcp:101:bash.0 Request processed in 12039us (13766us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783967136.011138:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1783967136.045923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967136.046043:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563792896 00000100:00100000:0.0:1783967136.046053:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563792896 00000100:00100000:0.0:1783967136.046268:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:0.0:1783967136.046279:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+15:15597:x1870624563792896:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967136.046304:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967136.046328:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b3160685f4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d711e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.046394:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.046408:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.046418:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783967136.046566:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1783967136.047236:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783967136.047258:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783967136.047290:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.047304:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.047335:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b3160685f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d711e expref: 17 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.047355:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d711e expref: 16 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.047364:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967136.047367:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783967136.047370:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783967136.047444:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+16:15597:x1870624563792896:12345-192.168.204.59@tcp:101:bash.0 Request processed in 1166us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967136.047452:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:1.0:1783967136.053438:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967136.053578:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563793152 00000100:00100000:3.0:1783967136.053587:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563793152 00000100:00100000:3.0:1783967136.053642:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783967136.053653:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+16:15597:x1870624563793152:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:3.0:1783967136.053972:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+17:15597:x1870624563793152:12345-192.168.204.59@tcp:35:bash.0 Request processed in 320us (543us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1783967136.053980:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783967136.120270:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967136.120294:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587994880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967136.120364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967136.120715:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587995008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967136.120746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967136.121082:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587994880 00000100:00100000:1.0:1783967136.121090:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587994880 00000100:00100000:1.0:1783967136.121139:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587995008 00000100:00100000:1.0:1783967136.121143:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587995008 00000100:00100000:1.0:1783967136.121161:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783967136.121171:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587994880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967136.121207:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967136.121264:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587994880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967136.121271:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783967136.121292:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967136.121299:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587995008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967136.121316:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967136.121346:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587995008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967136.121370:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783967136.121693:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587995008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967136.121708:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587994880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967136.188741:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967136.188978:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563793408 00000100:00100000:1.0:1783967136.189002:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563793408 00000100:00100000:1.0:1783967136.189075:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1783967136.189086:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+17:15607:x1870624563793408:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783967136.189120:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967136.189141:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7125 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967136.189245:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783967136.189356:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068602 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7125 expref: 19 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.189372:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:1.0:1783967136.189375:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967136.189381:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7125 expref: 19 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.189398:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62200, rc 0) 00000100:00100000:1.0:1783967136.189971:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+18:15607:x1870624563793408:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 883us (1236us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1783967136.189980:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:3.0:1783967136.198080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967136.198399:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563793664 00000100:00100000:0.0:1783967136.198409:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563793664 00000100:00100000:0.0:1783967136.198474:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:0.0:1783967136.198484:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+18:15607:x1870624563793664:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:0.0:1783967136.198743:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+19:15607:x1870624563793664:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 260us (690us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1783967136.198752:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:2.0:1783967136.306598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967136.306745:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563793920 00000100:00100000:0.0:1783967136.306755:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563793920 00000100:00100000:0.0:1783967136.306855:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1783967136.306881:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+19:15610:x1870624563793920:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:0.0:1783967136.306906:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967136.306930:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068610 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d712c expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.307035:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068617 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.307394:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.307407:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068617 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967136.307419:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783967136.307868:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068610 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d712c expref: 22 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.307888:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068617 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d712c expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.307898:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967136.307901:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783967136.307904:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0e00, rc 0) 00000100:00100000:0.0:1783967136.308016:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+21:15610:x1870624563793920:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1137us (1429us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783967136.308024:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00010000:00010000:1.0:1783967136.310949:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967136.315512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967136.315570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967136.315657:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563794176 00000100:00100000:0.0:1783967136.315669:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563794176 00000100:00100000:0.0:1783967136.315901:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967136.315912:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+21:2402:x1870624563794176:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967136.315928:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967136.315954:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068617 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d712c expref: 21 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.315972:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967136.316106:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967136.316376:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+20:2402:x1870624563794176:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 464us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967136.316385:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1783967136.316410:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563794048 00000100:00100000:1.0:1783967136.316417:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563794048 00000100:00100000:1.0:1783967136.316456:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1783967136.316465:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+20:15610:x1870624563794048:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783967136.316531:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316559:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316570:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316606:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316614:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316622:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316628:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967136.316632:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316641:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316650:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.316653:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967136.316656:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.316662:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b316068625 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967136.316699:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+20:15610:x1870624563794048:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 235us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967136.316724:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:3.0:1783967136.323725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967136.323806:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563794432 00000100:00100000:1.0:1783967136.323818:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563794432 00000100:00100000:1.0:1783967136.323882:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1783967136.323893:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+20:15610:x1870624563794432:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783967136.324149:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+21:15610:x1870624563794432:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 257us (434us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783967136.324158:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783967136.698551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967136.699224:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563794688 00000100:00100000:0.0:1783967136.699236:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563794688 00000100:00100000:0.0:1783967136.701493:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1783967136.701518:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+21:15641:x1870624563794688:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:0.0:1783967136.701543:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967136.701566:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606862c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7133 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.701676:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068633 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.701690:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.701713:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967136.701725:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783967136.701886:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b31606862c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7133 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.701904:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7133 expref: 23 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.701914:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967136.701917:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783967136.701920:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1600, rc 0) 00000100:00100000:0.0:1783967136.702006:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+23:15641:x1870624563794688:12345-192.168.204.59@tcp:101:cat.0 Request processed in 498us (3462us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1783967136.702013:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1783967136.709069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967136.709160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967136.709566:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563795072 00000100:00100000:3.0:1783967136.709577:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563795072 00000100:00100000:3.0:1783967136.709638:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1783967136.709647:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+23:15641:x1870624563795072:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:3.0:1783967136.710241:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+24:15641:x1870624563795072:12345-192.168.204.59@tcp:35:cat.0 Request processed in 592us (1077us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1783967136.710250:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:0.0:1783967136.712673:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563794816 00000100:00100000:0.0:1783967136.712687:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563794816 00000100:00100000:0.0:1783967136.712759:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1783967136.712783:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+24:2400:x1870624563794816:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967136.712800:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967136.712826:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b316068633 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7133 expref: 24 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967136.712845:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967136.712850:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967136.713119:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+23:2400:x1870624563794816:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 350us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967136.713128:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1783967136.828537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967136.828661:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563795328 00000100:00100000:1.0:1783967136.828671:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563795328 00000100:00100000:1.0:1783967136.828736:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1783967136.828746:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+23:15647:x1870624563795328:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783967136.828814:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967136.828836:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068641 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d713a expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.828938:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068648 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.828952:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.828963:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967136.829105:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783967136.829228:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068641 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d713a expref: 26 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.829261:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d713a expref: 25 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.829269:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.829273:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783967136.829276:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62e00, rc 0) 00000100:00100000:1.0:1783967136.829346:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15647:x1870624563795328:12345-192.168.204.59@tcp:101:dd.0 Request processed in 600us (816us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1783967136.829354:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:2.0:1783967136.835443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967136.836333:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563795584 00000100:00100000:3.0:1783967136.836344:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563795584 00000100:00100000:2.0:1783967136.836489:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967136.837388:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563795456 00000100:00100000:1.0:1783967136.837396:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563795456 00000100:00100000:1.0:1783967136.837456:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:1.0:1783967136.837466:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+26:15647:x1870624563795456:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783967136.837488:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967136.837510:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068656 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7141 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837544:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837557:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837568:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837679:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068656 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 28 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837705:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 27 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.837713:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.837715:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783967136.837718:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62200, rc 0) 00000100:00100000:1.0:1783967136.837804:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+27:15647:x1870624563795456:12345-192.168.204.59@tcp:101:dd.0 Request processed in 340us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967136.837812:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:3.0:1783967136.837963:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1783967136.837987:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+26:2402:x1870624563795584:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967136.837997:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967136.838012:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068648 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d713a expref: 26 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967136.838023:0:19433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967136.838026:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967136.838062:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+25:2402:x1870624563795584:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 78us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967136.838070:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1783967136.851937:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967136.853534:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563795840 00000100:00100000:1.0:1783967136.853547:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563795840 00000100:00100000:1.0:1783967136.853762:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:1.0:1783967136.853792:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15647:x1870624563795840:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:1.0:1783967136.853845:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967136.853872:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b3160685fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d711e expref: 25 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.853890:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.853894:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783967136.854058:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.854072:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.854082:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783967136.854149:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1783967136.854170:0:17097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085036e21 reply state 000000007241f5c0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.854182:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967136.854188:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967136.854191:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967136.854194:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783967136.854294:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+27:15647:x1870624563795840:12345-192.168.204.59@tcp:36:dd.0 Request processed in 521us (2370us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1783967136.854301:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000020:00080000:1.0:1783967136.854305:0:17097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783967136.989376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967136.989516:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563796096 00000100:00100000:3.0:1783967136.989526:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563796096 00000100:00100000:3.0:1783967136.989590:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1783967136.989600:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+27:15647:x1870624563796096:12345-192.168.204.59@tcp:35:dd.0 00000100:00100000:3.0:1783967136.990222:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+28:15647:x1870624563796096:12345-192.168.204.59@tcp:35:dd.0 Request processed in 620us (853us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1783967136.990231:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000040:00080000:1.0:1783967137.016756:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967137.252431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.252547:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563796224 00000100:00100000:1.0:1783967137.252558:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563796224 00000100:00100000:1.0:1783967137.252623:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:1.0:1783967137.252634:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+28:15661:x1870624563796224:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:1.0:1783967137.252669:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967137.252691:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606866b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7148 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252759:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252806:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252838:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252852:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252859:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252866:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252940:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252950:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.252957:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967137.252999:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783967137.253004:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967137.253041:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253053:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253062:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253077:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253096:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253102:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967137.253106:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253113:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253126:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:1.0:1783967137.253129:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967137.253133:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253139:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b316068672 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253153:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253159:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253164:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253169:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967137.253178:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253184:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253191:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a05f1a82800) 00010000:00010000:1.0:1783967137.253194:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967137.253198:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253203:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068679 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253231:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b31606866b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7148 expref: 30 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253246:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7148 expref: 29 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.253252:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967137.253254:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783967137.253257:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62000, rc 0) 00000100:00100000:1.0:1783967137.253413:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+29:15661:x1870624563796224:12345-192.168.204.59@tcp:101:stat.0 Request processed in 779us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967137.253421:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00010000:00010000:0.0:1783967137.335125:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967137.341502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.341759:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563796480 00000100:00100000:1.0:1783967137.341799:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563796480 00000100:00100000:1.0:1783967137.341863:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1783967137.341873:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+29:15667:x1870624563796480:12345-192.168.204.59@tcp:36:truncate.0 00010000:00010000:1.0:1783967137.341947:0:17097:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967137.341976:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b316068680 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7148 expref: 29 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.341996:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967137.342001:0:17097:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783967137.342199:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.342214:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.342224:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783967137.342267:0:17097:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1783967137.342287:0:17097:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9942d62 reply state 0000000069a18ac0 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.342299:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.342306:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967137.342308:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967137.342311:0:17097:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783967137.342589:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+31:15667:x1870624563796480:12345-192.168.204.59@tcp:36:truncate.0 Request processed in 716us (1094us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1783967137.342597:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000020:00080000:1.0:1783967137.342602:0:17097:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783967137.507653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967137.509298:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563796608 00000100:00100000:0.0:1783967137.509329:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563796608 00000100:00100000:0.0:1783967137.509450:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:0.0:1783967137.509462:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+31:15681:x1870624563796608:12345-192.168.204.59@tcp:101:stat.0 00010000:00010000:0.0:1783967137.509486:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967137.509507:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606868e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d714f expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509582:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509597:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509609:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509620:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509627:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509633:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509841:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509852:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.509859:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967137.510139:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1783967137.510145:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783967137.510166:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510178:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510187:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510192:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510260:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510266:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967137.510270:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510277:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510287:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:0.0:1783967137.510290:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967137.510294:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510300:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068695 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510321:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510327:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510332:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510336:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967137.510339:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510344:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510349:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a05f1a82800) 00010000:00010000:0.0:1783967137.510351:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967137.510354:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510358:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1c00/0x9269c8b31606869c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510383:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1600/0x9269c8b31606868e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 33 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510394:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 32 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.510409:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967137.510412:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783967137.510414:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051400, rc 0) 00000100:00100000:0.0:1783967137.511427:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+32:15681:x1870624563796608:12345-192.168.204.59@tcp:101:stat.0 Request processed in 1961us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967137.511436:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1783967137.641998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.642117:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563796864 00000100:00100000:1.0:1783967137.642140:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563796864 00000100:00100000:1.0:1783967137.642216:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1783967137.642227:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+32:15691:x1870624563796864:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783967137.642251:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967137.642274:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7156 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967137.642383:0:17097:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783967137.642491:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7156 expref: 34 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.642508:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:1.0:1783967137.642511:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967137.642516:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7156 expref: 34 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.642531:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62000, rc 0) 00000100:00100000:1.0:1783967137.642602:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+33:15691:x1870624563796864:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 377us (616us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1783967137.642609:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:2.0:1783967137.651024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.651106:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563797120 00000100:00100000:1.0:1783967137.651117:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563797120 00000100:00100000:1.0:1783967137.651178:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1783967137.651189:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed253050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+33:15691:x1870624563797120:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783967137.652966:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed253050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+34:15691:x1870624563797120:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 1770us (1942us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1783967137.652978:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1783967137.796160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967137.796278:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563797376 00000100:00100000:0.0:1783967137.796289:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563797376 00000100:00100000:0.0:1783967137.796354:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:0.0:1783967137.796364:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+34:15697:x1870624563797376:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967137.796390:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967137.796412:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d715d expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796527:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796543:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 35 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796715:0:17096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 35 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796726:0:17096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796759:0:17096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 35 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796808:0:17096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 35 pid: 17096 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967137.796823:0:17096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf065500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17096:1870624587995136:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783967137.796920:0:17096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 35 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.796929:0:17096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 35 pid: 17095 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967137.796938:0:17096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf066300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17096:1870624587995264:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967137.796960:0:17096:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1783967137.803207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967137.803229:0:17096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf065500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17096:1870624587995136:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783967137.803256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967137.803293:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563797504 00000100:00100000:2.0:1783967137.803302:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563797504 00010000:00010000:2.0:1783967137.803346:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 36 pid: 17096 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967137.803394:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563797632 00000100:00100000:2.0:1783967137.803397:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563797632 00010000:00010000:2.0:1783967137.803410:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 37 pid: 17095 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967137.803436:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1783967137.803445:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+37:2400:x1870624563797504:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967137.803461:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967137.803468:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 37 pid: 17096 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.803481:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 37 pid: 17096 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.803504:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051400/0x9269c8b3160686a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d714f expref: 37 pid: 17096 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.803535:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:2.0:1783967137.803540:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.803560:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.803567:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967137.803619:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+36:2400:x1870624563797504:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 174us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967137.803626:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:3.0:1783967137.803809:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:3.0:1783967137.803819:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+35:2400:x1870624563797632:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967137.803827:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967137.803832:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 35 pid: 17095 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.803855:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 35 pid: 17095 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.803867:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967137.803871:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.803879:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.803887:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.803903:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967137.803924:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+35:2400:x1870624563797632:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 107us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967137.803931:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00010000:00010000:0.0:1783967137.805702:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160685e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7117 expref: 34 pid: 17095 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967137.805725:0:17096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf066300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17096:1870624587995264:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783967137.805751:0:17096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.805761:0:17096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.805767:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967137.805815:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1783967137.805953:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 35 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.805968:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 34 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.805976:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967137.805979:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783967137.805982:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051a00, rc 0) 00000100:00100000:0.0:1783967137.806033:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+34:15697:x1870624563797376:12345-192.168.204.59@tcp:101:bash.0 Request processed in 9670us (9884us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1783967137.806041:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:3.0:1783967137.814039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967137.814186:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563797888 00000100:00100000:2.0:1783967137.814196:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563797888 00000100:00100000:2.0:1783967137.814642:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1783967137.814655:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+34:15697:x1870624563797888:12345-192.168.204.59@tcp:36:bash.0 00010000:00010000:2.0:1783967137.814930:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.814948:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.814961:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783967137.815019:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1783967137.815040:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd33b7fc reply state 00000000297de5d6 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.815082:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.815092:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:2.0:1783967137.815095:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783967137.815105:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783967137.815212:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15697:x1870624563797888:12345-192.168.204.59@tcp:36:bash.0 Request processed in 558us (1180us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1783967137.815220:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000020:00080000:2.0:1783967137.815234:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783967137.825126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967137.825226:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798016 00000100:00100000:0.0:1783967137.825236:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798016 00000100:00100000:0.0:1783967137.825307:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783967137.825319:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15697:x1870624563798016:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967137.825344:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967137.825366:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7164 expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.825429:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7164 expref: 38 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.825445:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686d4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7164 expref: 38 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.825484:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967137.825487:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783967137.825491:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051000, rc 0) 00000100:00100000:0.0:1783967137.825562:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15697:x1870624563798016:12345-192.168.204.59@tcp:101:bash.0 Request processed in 245us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967137.825570:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:1.0:1783967137.836256:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967137.836505:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798144 00000100:00100000:2.0:1783967137.836515:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798144 00000100:00100000:2.0:1783967137.836656:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1783967137.836821:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15697:x1870624563798144:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783967137.836842:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967137.837049:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160686db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d716b expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.837161:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.837177:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 39 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.837187:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.837224:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 39 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.837252:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 39 pid: 17096 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967137.837267:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587995392:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783967137.837358:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967137.840358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967137.840425:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798272 00000100:00100000:0.0:1783967137.840437:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798272 00010000:00010000:0.0:1783967137.840476:0:19433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 40 pid: 17096 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967137.840527:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:2.0:1783967137.840528:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587995392:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967137.840540:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+40:2401:x1870624563798272:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967137.840556:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967137.840565:0:19433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 40 pid: 17096 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.840571:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.840580:0:19433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 40 pid: 17096 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.844123:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051a00/0x9269c8b3160686bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d715d expref: 40 pid: 17096 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.844260:0:19433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967137.844266:0:19433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.844294:0:19433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.844303:0:19433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967137.844342:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967137.844408:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+39:2401:x1870624563798272:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 3870us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967137.845837:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00010000:00010000:2.0:1783967137.846669:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.846682:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967137.846754:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783967137.846759:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967137.846808:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.846860:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b3160686db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d716b expref: 39 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.846880:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d716b expref: 38 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967137.846889:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:2.0:1783967137.846911:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783967137.846915:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783967137.847000:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15697:x1870624563798144:12345-192.168.204.59@tcp:101:bash.0 Request processed in 10183us (10753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967137.847008:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:3.0:1783967137.851263:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.851362:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798528 00000100:00100000:1.0:1783967137.851375:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798528 00000100:00100000:1.0:1783967137.851450:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783967137.851462:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15697:x1870624563798528:12345-192.168.204.59@tcp:103:bash.0 00010000:00010000:1.0:1783967137.851478:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783967137.851505:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051000/0x9269c8b3160686d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7164 expref: 38 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.851529:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b3160686e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d716b expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.851541:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967137.851545:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967137.851624:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+36:15697:x1870624563798528:12345-192.168.204.59@tcp:103:bash.0 Request processed in 164us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967137.851633:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783967137.857323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967137.857424:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798656 00000100:00100000:3.0:1783967137.857446:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798656 00000100:00100000:3.0:1783967137.857505:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:3.0:1783967137.857515:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+36:15697:x1870624563798656:12345-192.168.204.59@tcp:58:bash.0 00010000:00010000:3.0:1783967137.857620:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.857639:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967137.857652:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967137.859107:0:17097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967137.860188:0:17097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1783967137.860375:0:17097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1783967137.860560:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+36:15697:x1870624563798656:12345-192.168.204.59@tcp:58:bash.0 Request processed in 3030us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967137.860574:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:2.0:1783967137.866113:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967137.866225:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798784 00000100:00100000:1.0:1783967137.866235:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798784 00000100:00100000:1.0:1783967137.866310:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1783967137.866322:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+36:15697:x1870624563798784:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1783967137.866346:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967137.866369:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7172 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866465:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866476:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866505:0:17095:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866519:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866532:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967137.866536:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783967137.866539:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 37 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967137.866547:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c7d62c00, rc 0) 00000100:00100000:1.0:1783967137.866615:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15697:x1870624563798784:12345-192.168.204.59@tcp:101:bash.0 Request processed in 296us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967137.866623:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00010000:00010000:1.0:1783967138.358946:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967138.679211:0:17131:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783967138.679221:0:17131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783967138.679251:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783967138.679267:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783967138.679548:0:17131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17131:1870624587995520:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783967138.679719:0:17131:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967138.680184:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967138.680197:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587995648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783967138.680253:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967138.680340:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587995648 00000100:00100000:1.0:1783967138.680348:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587995648 00000100:00100000:1.0:1783967138.680418:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967138.680439:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587995648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783967138.680471:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967138.680536:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587995648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.680544:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783967138.680587:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587995648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783967138.680833:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967138.697120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.697873:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563798912 00000100:00100000:0.0:1783967138.697885:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563798912 00000100:00100000:0.0:1783967138.697976:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1783967138.697988:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563798912:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783967138.698021:0:17097:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783967138.698185:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563798912:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 199us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.698194:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00080000:2.0:1783967138.698269:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967138.702112:0:17131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44ece00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17131:1870624587995520:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783967138.710396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.710634:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563799040 00000100:00100000:1.0:1783967138.710644:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563799040 00000100:00100000:1.0:1783967138.711039:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:1.0:1783967138.711051:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15699:x1870624563799040:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783967138.711143:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711161:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711173:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711234:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711243:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711251:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711280:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711307:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.711314:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967138.711363:0:17096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783967138.711368:0:17096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967138.711381:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712101:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712110:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712119:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712562:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967138.712569:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712579:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712594:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05f1a82300) 00010000:00010000:1.0:1783967138.712598:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967138.712603:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712626:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62000/0x9269c8b3160686f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.712643:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713437:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713444:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713449:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967138.713452:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713459:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713469:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a05f1a82600) 00010000:00010000:1.0:1783967138.713472:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967138.713475:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713480:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62e00/0x9269c8b3160686fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713586:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713593:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713613:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713617:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ea00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967138.713621:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713628:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713636:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967138.713640:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967138.713642:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.713657:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274ea00/0x9269c8b316068705 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.713802:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15699:x1870624563799040:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 2747us (3419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.713812:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1783967138.716651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.716902:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563799296 00000100:00100000:1.0:1783967138.716913:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563799296 00000100:00100000:1.0:1783967138.716977:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:1.0:1783967138.716988:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+37:15699:x1870624563799296:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967138.717014:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967138.717037:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b31606870c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7179 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717182:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717198:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717211:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967138.717223:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783967138.717311:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717319:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717325:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717331:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967138.717335:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717347:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717359:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:1.0:1783967138.717363:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783967138.717369:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717390:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0c00/0x9269c8b316068713 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717447:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b31606870c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7179 expref: 39 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717458:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05f1a82300) 00010000:00010000:1.0:1783967138.717460:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967138.717464:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b31606870c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7179 expref: 39 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.717474:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1200, rc 0) 00000100:00100000:1.0:1783967138.717534:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563799296:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 547us (893us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1783967138.717541:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1783967138.723587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.723679:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563799424 00000100:00100000:1.0:1783967138.723690:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563799424 00000100:00100000:1.0:1783967138.723991:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1783967138.724005:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563799424:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783967138.724063:0:17096:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783967138.724190:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563799424:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 188us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.724197:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1783967138.736967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.737221:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563799680 00000100:00100000:3.0:1783967138.737232:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563799680 00000100:00100000:3.0:1783967138.737296:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:3.0:1783967138.737306:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+38:15699:x1870624563799680:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967138.737326:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967138.737349:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068721 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7180 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783967138.738031:0:17097:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:3.0:1783967138.738038:0:17097:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1783967138.738071:0:17097:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1783967138.738229:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068728 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.738245:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.738257:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.738327:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068721 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7180 expref: 41 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.738351:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7180 expref: 40 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.738362:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426300) 00010000:00010000:3.0:1783967138.738365:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783967138.738369:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178a00, rc 0) 00000100:00100000:3.0:1783967138.738635:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+40:15699:x1870624563799680:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1328us (1680us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1783967138.738644:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:0.0:1783967138.756420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.756882:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563799936 00000100:00100000:3.0:1783967138.756895:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563799936 00000100:00100000:2.0:1783967138.757223:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1783967138.757235:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+40:15699:x1870624563799936:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.757300:0:17095:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967138.757329:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b316068728 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7180 expref: 40 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757351:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426300) 00010000:00010000:2.0:1783967138.757362:0:17095:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783967138.757401:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757416:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757427:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757443:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757450:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757456:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757499:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757506:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757513:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757519:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967138.757524:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757531:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757551:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967138.757554:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967138.757557:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757563:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630800/0x9269c8b316068736 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757572:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757578:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757583:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757589:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967138.757593:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757599:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757606:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfe2f1fd3 (ffff9a04c1ccac00) 00010000:00010000:2.0:1783967138.757608:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967138.757611:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.757617:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b31606873d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe2f1fd3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967138.758285:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+39:15699:x1870624563799936:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1048us (1870us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783967138.758294:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1783967138.764564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.764646:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563800064 00000100:00100000:3.0:1783967138.764656:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563800064 00000100:00100000:3.0:1783967138.764746:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1783967138.764757:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+39:15699:x1870624563800064:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967138.764813:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967138.764838:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068744 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7187 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.764885:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606874b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.764898:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606874b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.764910:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606874b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.765046:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b316068744 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7187 expref: 41 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.765076:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606874b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7187 expref: 40 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.765085:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:3.0:1783967138.765088:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783967138.765091:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178a00, rc 0) 00000100:00100000:3.0:1783967138.765158:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+40:15699:x1870624563800064:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 402us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967138.765165:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:3.0:1783967138.773983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.774106:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563800320 00000100:00100000:2.0:1783967138.774118:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563800320 00000100:00100000:2.0:1783967138.774197:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:2.0:1783967138.774208:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+40:15699:x1870624563800320:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.774332:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.774352:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.774365:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783967138.774548:0:17095:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1783967138.774558:0:17095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 614975787177ns, next at 615975784662ns, rc = 0 00000004:00010000:2.0:1783967138.774614:0:17095:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027ddf8a1 reply state 00000000eeaec150 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.774628:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.774636:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:2.0:1783967138.774639:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783967138.774642:0:17095:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783967138.774756:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+42:15699:x1870624563800320:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 548us (786us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1783967138.774821:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:0.0:1783967138.790999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.791136:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563800448 00000100:00100000:1.0:1783967138.791148:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563800448 00000100:00100000:1.0:1783967138.791216:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1783967138.791245:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+42:15699:x1870624563800448:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967138.791271:0:17096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967138.791294:0:17096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d718e expref: -99 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.791365:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 43 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.791394:0:17096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 43 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.791414:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:1.0:1783967138.791418:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783967138.791422:0:17096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1200, rc 0) 00000100:00100000:1.0:1783967138.791498:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+43:15699:x1870624563800448:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 255us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.791506:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:0.0:1783967138.798257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.798365:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563800576 00000100:00100000:2.0:1783967138.798376:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563800576 00000100:00100000:2.0:1783967138.798450:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:2.0:1783967138.798526:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2401:x1870624563800576:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783967138.799272:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967138.799436:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2401:x1870624563800576:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 972us (1186us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783967138.799445:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1783967138.811985:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.812350:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563800832 00000100:00100000:0.0:1783967138.812363:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563800832 00000100:00100000:0.0:1783967138.812499:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783967138.812511:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+43:15699:x1870624563800832:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783967138.812834:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+44:15699:x1870624563800832:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 324us (863us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783967138.812842:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:0.0:1783967138.827737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.827868:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801088 00000100:00100000:3.0:1783967138.827879:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801088 00000100:00100000:3.0:1783967138.827957:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:3.0:1783967138.827977:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+44:15699:x1870624563801088:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783967138.828127:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+44:15699:x1870624563801088:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 160us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967138.828136:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 65 00000100:00100000:3.0:1783967138.834397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.834522:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801216 00000100:00100000:2.0:1783967138.834532:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801216 00000100:00100000:2.0:1783967138.834632:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783967138.834643:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+44:15699:x1870624563801216:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.834665:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967138.834685:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316068760 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7195 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834804:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834821:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834834:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967138.834890:0:17095:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967138.834910:0:17095:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834954:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631200/0x9269c8b316068760 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7195 expref: 46 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834972:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7195 expref: 45 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.834981:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:2.0:1783967138.834984:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783967138.834988:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783967138.835062:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+45:15699:x1870624563801216:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 421us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967138.835070:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 66 00000100:00100000:2.0:1783967138.839448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.839538:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801344 00000100:00100000:0.0:1783967138.839549:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801344 00000100:00100000:0.0:1783967138.839614:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1783967138.839626:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2400:x1870624563801344:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783967138.839647:0:19333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967138.839669:0:19333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d719c expref: -99 pid: 19333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783967138.839697:0:19333:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552da2, blocks: 0x0 00010000:00010000:0.0:1783967138.839719:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1783967138.839724:0:19333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967138.839734:0:19333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 7 pid: 19333 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.839756:0:19333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 7 pid: 19333 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.839807:0:19333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050000, rc 0) 00000100:00100000:0.0:1783967138.840158:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2400:x1870624563801344:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 533us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.840166:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:0.0:1783967138.847637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.853273:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801600 00000100:00100000:1.0:1783967138.853289:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801600 00000100:00100000:1.0:1783967138.853445:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:1.0:1783967138.853456:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+45:15699:x1870624563801600:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783967138.853606:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+45:15699:x1870624563801600:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 151us (5980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.853614:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 67 00000100:00100000:3.0:1783967138.867727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.868123:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801728 00000100:00100000:2.0:1783967138.868135:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801728 00000100:00100000:2.0:1783967138.868208:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 68 00000100:00100000:2.0:1783967138.868220:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+45:15699:x1870624563801728:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783967138.875024:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00010000:00010000:0.0:1783967138.875196:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875208:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875216:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875222:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.875227:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875234:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875250:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a05f1a82a00) 00010000:00010000:0.0:1783967138.875253:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.875257:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875263:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63a00/0x9269c8b316068530 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875283:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875289:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875294:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875305:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.875308:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875314:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875322:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:0.0:1783967138.875324:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.875327:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875333:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63c00/0x9269c8b316068537 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875345:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875350:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875355:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.875359:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d63400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.875361:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783967138.875588:0:17076:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1783967138.876003:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876029:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a05f1a82800) 00010000:00010000:0.0:1783967138.876033:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.876220:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876228:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63400/0x9269c8b3160685df lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876254:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876261:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876266:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876271:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.876275:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876280:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876289:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967138.876292:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.876294:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876300:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a04c274e800/0x9269c8b316068664 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876323:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876330:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876335:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876339:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.876342:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876349:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876356:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967138.876358:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.876361:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876382:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62a00/0x9269c8b316068687 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876396:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876402:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876409:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876420:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.876424:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876430:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876439:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967138.876441:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967138.876444:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876449:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630000/0x9269c8b3160686cd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876461:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876480:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876487:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876492:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967138.876495:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876501:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876521:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:0.0:1783967138.876523:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783967138.876526:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.876531:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630a00/0x9269c8b316068752 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967138.878228:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587995776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783967138.878308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967138.878473:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587995776 00000100:00100000:3.0:1783967138.878482:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587995776 00000100:00100000:3.0:1783967138.878538:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783967138.878549:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587995776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783967138.878729:0:18603:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783967138.878732:0:18603:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783967138.878735:0:18603:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783967138.878737:0:18603:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783967138 -> 1783967138 00002000:00010000:3.0:1783967138.878740:0:18603:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:1.0:1783967138.879302:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1783967138.879834:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+14:15699:x1870624563801728:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 11611us (12121us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967138.879844:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 68 00010000:00010000:2.0:1783967138.879924:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.879936:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.879945:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.879966:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967138.879971:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.879978:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.879995:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:2.0:1783967138.879998:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783967138.880002:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.880008:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316068584 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967138.884195:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624587995776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5636us (5875us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783967138.884210:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:0.0:1783967138.885642:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a04c274aa00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1783967138.885655:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587995776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783967138.888281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.888399:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563801856 00000100:00100000:0.0:1783967138.888414:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563801856 00000100:00100000:0.0:1783967138.888506:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:0.0:1783967138.888519:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2400:x1870624563801856:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783967138.888686:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2400:x1870624563801856:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 169us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.888694:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:1.0:1783967138.904688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.905407:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802112 00000100:00100000:2.0:1783967138.905429:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802112 00000100:00100000:2.0:1783967138.905505:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:2.0:1783967138.905516:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+14:15699:x1870624563802112:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.905581:0:17096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967138.905610:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068767 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7195 expref: 14 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.905630:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:2.0:1783967138.905646:0:17096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783967138.905676:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.905721:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.905732:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783967138.905921:0:17096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075e51e16 reply state 000000000c9e6e50 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.906182:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.906190:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:2.0:1783967138.906193:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783967138.906196:0:17096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783967138.906386:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+15:15699:x1870624563802112:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 870us (1708us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1783967138.906395:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 69 00000100:00100000:1.0:1783967138.921194:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.921292:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802240 00000100:00100000:2.0:1783967138.921301:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802240 00000100:00100000:2.0:1783967138.921527:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1783967138.921538:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15699:x1870624563802240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.921559:0:18601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967138.921584:0:18601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71a3 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.921621:0:18601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 8 pid: 19333 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.921655:0:18601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967138.921660:0:18601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967138.921666:0:18601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 8 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.921707:0:18601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 8 pid: 19333 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.921734:0:18601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 8 pid: 19333 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967138.921752:0:18601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18601:1870624587995904:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783967138.921868:0:18601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967138.925499:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.925585:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802368 00000100:00100000:1.0:1783967138.925595:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802368 00010000:00010000:1.0:1783967138.925637:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 9 pid: 19333 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.925679:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783967138.925690:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+9:2401:x1870624563802368:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783967138.925707:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967138.925746:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 9 pid: 19333 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.925762:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 9 pid: 19333 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.925828:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967138.925833:0:17081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967138.925841:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.925852:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.925907:0:17081:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.925961:0:17081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17081:1870624587996032:192.168.204.59@tcp:105: 00000100:00100000:1.0:1783967138.926062:0:17081:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af540 going to sleep for 11 seconds 00010000:00010000:3.0:1783967138.926250:0:18601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b31606876e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d719c expref: 9 pid: 19333 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967138.926264:0:18601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18601:1870624587995904:192.168.204.59@tcp:104: 00010000:00010000:3.0:1783967138.926300:0:18601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 8 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.926311:0:18601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:3.0:1783967138.926356:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+8:15699:x1870624563802240:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 4819us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967138.926364:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:0.0:1783967138.932365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.932525:0:17081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:17081:1870624587996032:192.168.204.59@tcp:105: 00010000:00010000:1.0:1783967138.932562:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967138.932646:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2401:x1870624563802368:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 6957us (7159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.932657:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:3.0:1783967138.932884:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802496 00000100:00100000:3.0:1783967138.932893:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802496 00000100:00100000:3.0:1783967138.932947:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1783967138.932957:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2401:x1870624563802496:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783967138.933134:0:18604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783967138.933139:0:18604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783967137 00002000:00010000:3.0:1783967138.933141:0:18604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783967135 00002000:00010000:3.0:1783967138.933143:0:18604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783967138 -> 1783967137 00002000:00010000:3.0:1783967138.933145:0:18604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1783967138.933174:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+8:2401:x1870624563802496:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 219us (822us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783967138.933181:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1783967138.938223:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.938323:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802624 00000100:00100000:0.0:1783967138.938333:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802624 00000100:00100000:0.0:1783967138.938389:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:0.0:1783967138.938399:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+8:2400:x1870624563802624:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783967138.938455:0:18603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.938491:0:18603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 8 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.938501:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967138.938505:0:18603:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783967138.938510:0:18603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.938547:0:18603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 8 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.938562:0:18603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 8 pid: 18601 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967138.938578:0:18603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05cf066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18603:1870624587996160:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967138.938668:0:18603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c80a6780 going to sleep for 11 seconds 00000100:00100000:2.0:1783967138.942183:0:18603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05cf066a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18603:1870624587996160:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967138.942216:0:18603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.944803:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.944979:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563802752 00000100:00100000:3.0:1783967138.944991:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563802752 00010000:00010000:3.0:1783967138.945032:0:19433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967138.945075:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1783967138.945085:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+9:2400:x1870624563802752:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967138.945118:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967138.945142:0:19433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.945155:0:19433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.945180:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b31606877c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71a3 expref: 9 pid: 18601 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.945196:0:19433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783967138.945200:0:19433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783967138.945206:0:19433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.945216:0:19433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.945243:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967138.945298:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+8:2400:x1870624563802752:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 214us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967138.945305:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00010000:00010000:2.0:1783967138.946204:0:18603:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946218:0:18603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946259:0:18603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946268:0:18603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946277:0:18603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946284:0:18603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967138.946288:0:18603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946297:0:18603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946310:0:18603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.946317:0:18603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e3bc4d8/0x9269c8b316068783 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967138.946405:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2400:x1870624563802624:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 8006us (8190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967138.946432:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1783967138.952332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.952556:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803008 00000100:00100000:2.0:1783967138.952569:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803008 00000100:00100000:2.0:1783967138.952653:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 70 00000100:00100000:2.0:1783967138.952665:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+15:15699:x1870624563803008:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783967138.952801:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.952822:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 15 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.952833:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.952871:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 15 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.952886:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 15 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967138.952903:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996288:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783967138.953000:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967138.957553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967138.957835:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996288:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967138.957879:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967138.958092:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803136 00000100:00100000:0.0:1783967138.958100:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803136 00010000:00010000:0.0:1783967138.958146:0:17082:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967138.958190:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:0.0:1783967138.958199:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+16:2401:x1870624563803136:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967138.958215:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967138.958235:0:17082:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958247:0:17082:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958272:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62200/0x9269c8b31606865d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7141 expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958288:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967138.958293:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958302:0:17082:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958309:0:17082:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958317:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.958351:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967138.958398:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+15:2401:x1870624563803136:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 200us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.958407:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:3.0:1783967138.959279:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959289:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959527:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959544:0:17095:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 15 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959552:0:17095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959588:0:17095:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 15 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.959603:0:17095:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 15 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967138.959616:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996416:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783967138.959699:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea6579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967138.964961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.965109:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803264 00000100:00100000:1.0:1783967138.965120:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803264 00010000:00010000:1.0:1783967138.965160:0:17081:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.965203:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:1.0:1783967138.965212:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+16:2400:x1870624563803264:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783967138.965228:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967138.965236:0:17081:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.965250:0:17081:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 16 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.965273:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:1.0:1783967138.965292:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.965304:0:17081:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.965312:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.965335:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967138.965456:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+16:2400:x1870624563803264:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 244us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.965465:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00010000:00010000:2.0:1783967138.965910:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1200/0x9269c8b316068759 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d718e expref: 15 pid: 17096 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967138.965935:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996416:192.168.204.59@tcp:104: 00010000:00010000:2.0:1783967138.965955:0:17095:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.965964:0:17095:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967138.965969:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783967138.966087:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1783967138.966203:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1783967138.966244:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1783967138.966326:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17095:1870624587996544:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783967138.966386:0:17095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967138.966430:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed308780 going to sleep for 11 seconds 00000100:00100000:1.0:1783967138.967858:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587996544 00000100:00100000:1.0:1783967138.967870:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587996544 00000100:00100000:1.0:1783967138.967928:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783967138.967952:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17095:x1870624587996544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783967138.968091:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17095:x1870624587996544:12345-0@lo:1000:mdt00_000.0 Request processed in 142us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.968098:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783967138.968258:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17095:1870624587996544:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1783967138.968462:0:17095:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1783967138.968531:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17095:1870624587996672:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783967138.968570:0:17095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967138.968600:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18b540 going to sleep for 11 seconds 00000100:00100000:2.0:1783967138.969124:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587996672 00000100:00100000:2.0:1783967138.969131:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587996672 00000100:00100000:2.0:1783967138.969166:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783967138.969195:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17095:x1870624587996672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783967138.969338:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17095:x1870624587996672:12345-0@lo:1000:mdt00_000.0 Request processed in 144us (765us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1783967138.969345:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783967138.969589:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7dfc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17095:1870624587996672:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1783967138.969647:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.969675:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.969682:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.969689:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967138.969694:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.969702:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970134:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:3.0:1783967138.970138:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783967138.970144:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970151:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068791 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970187:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970193:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970198:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970203:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967138.970213:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970219:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970229:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967138.970232:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783967138.970240:0:17095:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970250:0:17095:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.970259:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.970668:0:17095:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 18 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.970682:0:17095:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996800:192.168.204.59@tcp:105: 00000100:00100000:1.0:1783967138.970962:0:17095:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967138.976658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967138.977187:0:17095:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17095:1870624587996800:192.168.204.59@tcp:105: 00010000:00010000:3.0:1783967138.977217:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977228:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160686e9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977268:0:17095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977283:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977294:0:17095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977319:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977326:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977333:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977340:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967138.977345:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977352:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977364:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967138.977379:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967138.977383:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977390:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b316068798 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977400:0:17095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977406:0:17095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977413:0:17095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977734:0:17095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967138.977738:0:17095:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977744:0:17095:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977754:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967138.977756:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783967138.977760:0:17095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967138.977766:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630200/0x9269c8b31606878a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967138.978144:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803392 00000100:00100000:1.0:1783967138.978152:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803392 00000100:00100000:1.0:1783967138.978203:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:1.0:1783967138.978212:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+19:15697:x1870624563803392:12345-192.168.204.59@tcp:49:bash.0 00000100:00100000:1.0:1783967138.978343:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+19:15697:x1870624563803392:12345-192.168.204.59@tcp:49:bash.0 Request processed in 131us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967138.978351:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000040:00080000:0.0:1783967138.978643:0:17131:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783967138.978648:0:17131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783967138.978666:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000100:00100000:3.0:1783967138.978756:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+18:15699:x1870624563803008:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 26092us (26433us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1783967138.978765:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 70 00000020:00080000:3.0:1783967138.978844:0:17095:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783967138.978907:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783967138.982407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.982798:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803648 00000100:00100000:0.0:1783967138.982810:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803648 00000100:00100000:0.0:1783967138.982872:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1783967138.982883:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+18:15699:x1870624563803648:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783967138.983266:0:17098:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783967138.983300:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1783967138.983332:0:17098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983348:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983360:0:17098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983378:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983385:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983391:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.983453:0:17098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783967138.983545:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+20:15699:x1870624563803648:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 663us (1147us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1783967138.983553:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000020:00080000:0.0:1783967138.983558:0:17098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783967138.986791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1783967138.986799:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967138.986809:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.986821:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967138.986826:0:17850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.986836:0:17850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.986855:0:17850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:1.0:1783967138.986859:0:17850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783967138.986863:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.986868:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051e00/0x9269c8b31606879f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967138.986882:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967138.986883:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967138.986885:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967138.986946:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803776 00000100:00100000:0.0:1783967138.986981:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803776 00000100:00100000:0.0:1783967138.987038:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:0.0:1783967138.987058:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+7:15697:x1870624563803776:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967138.987076:0:18604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967138.987096:0:18604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b3160687a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71aa expref: -99 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783967138.987121:0:18604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a552da1, atime: 0x6a552d9f, ctime: 0x6a552da1, blocks: 0x0 00010000:00010000:0.0:1783967138.987143:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=615s v=(0 0) 00010000:00010000:0.0:1783967138.987147:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967138.987158:0:18604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b3160687a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71aa expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.987174:0:18604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b3160687a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71aa expref: 8 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.987187:0:18604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050000, rc 0) 00000100:00100000:0.0:1783967138.987253:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+8:15697:x1870624563803776:12345-192.168.204.59@tcp:101:bash.0 Request processed in 205us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.987259:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1783967138.992234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967138.992654:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563803904 00000100:00100000:0.0:1783967138.992664:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563803904 00000100:00100000:0.0:1783967138.992730:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:0.0:1783967138.992742:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+20:15697:x1870624563803904:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967138.992765:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967138.992816:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b3160687ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71b1 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.992867:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b3160687b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.992880:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b3160687b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.992891:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b3160687b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17097 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.993018:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050e00/0x9269c8b3160687ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71b1 expref: 22 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.993054:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b3160687b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71b1 expref: 21 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967138.993063:0:17097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:0.0:1783967138.993067:0:17097:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783967138.993070:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050600, rc 0) 00000100:00100000:0.0:1783967138.993142:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+21:15697:x1870624563803904:12345-192.168.204.59@tcp:101:bash.0 Request processed in 402us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967138.993149:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 71 00000100:00100000:2.0:1783967138.999411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967138.999510:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563804160 00000100:00100000:1.0:1783967138.999520:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563804160 00000100:00100000:1.0:1783967138.999580:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783967138.999589:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+21:15697:x1870624563804160:12345-192.168.204.59@tcp:35:bash.0 00000001:00080000:1.0:1783967138.999887:0:17099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1783967138.999972:0:17099:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1783967139.000103:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+24:15697:x1870624563804160:12345-192.168.204.59@tcp:35:bash.0 Request processed in 512us (699us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1783967139.000111:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000020:00080000:1.0:1783967139.000117:0:17099:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783967139.159354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.159417:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563804416 00000100:00100000:3.0:1783967139.159428:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563804416 00000100:00100000:3.0:1783967139.159496:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:3.0:1783967139.159506:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+24:15709:x1870624563804416:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967139.159530:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967139.159552:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160687bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71b8 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967139.159679:0:17095:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783967139.159840:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160687bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71b8 expref: 26 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.159856:0:17095:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:3.0:1783967139.159859:0:17095:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783967139.159865:0:17095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179800/0x9269c8b3160687bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71b8 expref: 26 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.159882:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179800, rc 0) 00000100:00100000:3.0:1783967139.159964:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15709:x1870624563804416:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 459us (619us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1783967139.159972:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 72 00000100:00100000:0.0:1783967139.166623:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.171222:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563804544 00000100:00100000:3.0:1783967139.171237:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563804544 00000100:00100000:3.0:1783967139.171356:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:3.0:1783967139.171367:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15709:x1870624563804544:12345-192.168.204.59@tcp:34:lfs.0 00010000:00010000:3.0:1783967139.171456:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171474:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171485:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171500:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171521:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171529:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171605:0:17096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171614:0:17096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171622:0:17096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783967139.171667:0:17096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171681:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171687:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171714:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171721:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602178400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967139.171725:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171733:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171752:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:3.0:1783967139.171755:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967139.171759:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171765:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178400/0x9269c8b3160687c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171811:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.171818:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172333:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172340:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967139.172343:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172350:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172359:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a04c3426f00) 00010000:00010000:3.0:1783967139.172362:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967139.172365:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172372:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179000/0x9269c8b3160687d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172563:0:17096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172570:0:17096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172576:0:17096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172580:0:17096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967139.172583:0:17096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172588:0:17096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172595:0:17096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967139.172597:0:17096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967139.172600:0:17096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967139.172606:0:17096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179a00/0x9269c8b3160687d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967139.172926:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15709:x1870624563804544:12345-192.168.204.59@tcp:34:lfs.0 Request processed in 1558us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967139.173003:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:2.0:1783967139.177017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967139.177156:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563804800 00000100:00100000:1.0:1783967139.177166:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563804800 00000100:00100000:1.0:1783967139.177341:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1783967139.177353:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+25:15709:x1870624563804800:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:1.0:1783967139.177599:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+26:15709:x1870624563804800:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 248us (591us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1783967139.177608:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00010000:00010000:0.0:1783967139.382990:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967139.584337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584500:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967139.584535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967139.584625:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805184 00000100:00100000:2.0:1783967139.584642:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805184 00000100:00100000:2.0:1783967139.584723:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805696 00000100:00100000:2.0:1783967139.584727:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805696 00000100:00100000:2.0:1783967139.584743:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805568 00000100:00100000:2.0:1783967139.584746:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805568 00000100:00100000:2.0:1783967139.584765:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1783967139.584807:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563805184:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967139.584877:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563805184:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 73us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967139.584885:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1783967139.584901:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1783967139.584908:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805696:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967139.584942:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805696:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 34us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967139.584948:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1783967139.584960:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1783967139.584966:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805568:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967139.584989:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805568:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967139.584995:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1783967139.585312:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805440 00000100:00100000:1.0:1783967139.585317:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805440 00000100:00100000:1.0:1783967139.585345:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805056 00000100:00100000:1.0:1783967139.585348:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805056 00000100:00100000:1.0:1783967139.585362:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805312 00000100:00100000:1.0:1783967139.585365:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805312 00000100:00100000:1.0:1783967139.585379:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:1.0:1783967139.585385:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805440:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967139.585433:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2400:x1870624563805440:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 47us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967139.585449:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 73 00000100:00100000:1.0:1783967139.585465:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:1.0:1783967139.585472:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563805056:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967139.585497:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2400:x1870624563805056:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 26us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967139.585503:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:1.0:1783967139.585515:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:1.0:1783967139.585521:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2400:x1870624563805312:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967139.585545:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2400:x1870624563805312:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967139.585550:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00080000:3.0:1783967139.586223:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967139.586228:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967139.586230:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967139.586233:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967139.587486:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563804928 00000100:00100000:0.0:1783967139.587498:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563804928 00000100:00100000:0.0:1783967139.587563:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:0.0:1783967139.587573:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:2400:x1870624563804928:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967139.587710:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+13:2400:x1870624563804928:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 138us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967139.587719:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00010000:00010000:3.0:1783967140.415198:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967140.727824:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c443c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587996928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967140.727894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.727953:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587996928 00000100:00100000:1.0:1783967140.727961:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587996928 00000100:00100000:1.0:1783967140.728026:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783967140.728037:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587996928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967140.728070:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783967140.728116:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624587996928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.728124:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783967140.728145:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967140.728184:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c443c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624587996928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783967140.731079:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587997312:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967140.731189:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587997824:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967140.731225:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587998336:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967140.731273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783967140.731279:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587997184:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731322:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967140.731344:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587997696:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967140.731377:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587998208:0@lo:400:kworker.0 00000100:00100000:3.0:1783967140.731395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.731993:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998336 00000100:00100000:1.0:1783967140.732008:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998336 00000100:00100000:1.0:1783967140.732081:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998208 00000100:00100000:1.0:1783967140.732085:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998208 00000100:00100000:1.0:1783967140.732104:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783967140.732112:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587998336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732175:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624587998336:12345-0@lo:400:kworker.0 Request processed in 64us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.732183:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783967140.732200:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783967140.732206:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587998208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732233:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624587998208:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.732239:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783967140.732256:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997184 00000100:00100000:1.0:1783967140.732260:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997184 00000100:00100000:1.0:1783967140.732276:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997696 00000100:00100000:1.0:1783967140.732278:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997696 00000100:00100000:1.0:1783967140.732289:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783967140.732295:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587997184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732326:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587997184:12345-0@lo:400:kworker.0 Request processed in 31us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.732332:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783967140.732344:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783967140.732350:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587997696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732376:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587997696:12345-0@lo:400:kworker.0 Request processed in 27us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.732381:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783967140.732433:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587997056:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732580:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587997568:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732621:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587998080:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732838:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587998592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967140.732863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732884:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783967140.732891:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587997440:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732930:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587997952:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.732965:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587998464:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.732983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967140.733006:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997056 00000100:00100000:1.0:1783967140.733011:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997056 00000100:00100000:1.0:1783967140.733188:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783967140.733196:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624587997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.733246:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624587997056:12345-0@lo:400:kworker.0 Request processed in 51us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.733254:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783967140.733283:0:20236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998592 00000100:00100000:1.0:1783967140.733287:0:20236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998592 00000100:00100000:1.0:1783967140.733314:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783967140.733320:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587998592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967140.733351:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967140.733401:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587998592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967140.733408:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783967140.734301:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997312 00000100:00100000:0.0:1783967140.734310:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997312 00000100:00100000:0.0:1783967140.734351:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997824 00000100:00100000:0.0:1783967140.734355:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997824 00000100:00100000:0.0:1783967140.734366:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997440 00000100:00100000:0.0:1783967140.734368:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997440 00000100:00100000:0.0:1783967140.734383:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783967140.734390:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1870624587997312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.734457:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1870624587997312:12345-0@lo:400:kworker.0 Request processed in 67us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.734464:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783967140.735097:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967140.735103:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967140.735105:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967140.735108:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967140.735923:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783967140.735938:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587997824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.736003:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f4cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587997824:12345-0@lo:400:kworker.0 Request processed in 70us (4791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.736010:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783967140.736035:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783967140.736052:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587997440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.736083:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587997440:12345-0@lo:400:kworker.0 Request processed in 42us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.736090:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783967140.736126:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997568 00000100:00100000:0.0:1783967140.736134:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997568 00000100:00100000:0.0:1783967140.736182:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998080 00000100:00100000:0.0:1783967140.736185:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998080 00000100:00100000:0.0:1783967140.736214:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587997952 00000100:00100000:0.0:1783967140.736217:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587997952 00000100:00100000:0.0:1783967140.736227:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998464 00000100:00100000:0.0:1783967140.736230:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998464 00000100:00100000:0.0:1783967140.736246:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783967140.736251:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587997568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.736284:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624587997568:12345-0@lo:400:kworker.0 Request processed in 33us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.736290:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783967140.736302:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783967140.736308:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587998080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.736336:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624587998080:12345-0@lo:400:kworker.0 Request processed in 28us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.736341:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783967140.736352:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783967140.736359:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587997952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.736387:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624587997952:12345-0@lo:400:kworker.0 Request processed in 29us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.736393:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783967140.736404:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783967140.736410:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587998464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736805:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587997440:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736820:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624587997952:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736831:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624587997056:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736841:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624587997568:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736851:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624587998080:0@lo:400:kworker.0 00000100:00100000:1.0:1783967140.736870:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587998592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967140.738880:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624587998464:12345-0@lo:400:kworker.0 Request processed in 2466us (5892us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.738891:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1783967140.738933:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967140.738946:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967140.739000:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587997184:0@lo:400:kworker.0 00010000:00080000:1.0:1783967140.739936:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fd0a80 x1870624587998464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967140.739950:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624587998464:0@lo:400:kworker.0 00000100:00100000:2.0:1783967140.740464:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587998720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967140.740547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967140.742660:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587997696:0@lo:400:kworker.0 00010000:00080000:0.0:1783967140.742707:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3fd3100 x1870624587998208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967140.742718:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624587998208:0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.742736:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587997312:0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.742748:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587997824:0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.742760:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624587998336:0@lo:400:kworker.0 00000100:00100000:0.0:1783967140.742854:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998720 00000100:00100000:0.0:1783967140.742862:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998720 00000100:00100000:0.0:1783967140.742915:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783967140.742925:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587998720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783967140.742955:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967140.743065:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587998720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967140.743074:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967140.744578:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587998720:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1783967140.974535:0:20274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1783967141.241371:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967141.241399:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587998848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967141.241478:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967141.241534:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967141.241544:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587998976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967141.241568:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967141.241604:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998848 00000100:00100000:3.0:1783967141.241612:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998848 00000100:00100000:3.0:1783967141.241664:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587998976 00000100:00100000:3.0:1783967141.241667:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587998976 00000100:00100000:3.0:1783967141.241683:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783967141.241691:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587998848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783967141.241730:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783967141.241793:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587998848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967141.241801:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783967141.241818:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783967141.241824:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587998976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967141.241841:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1783967141.241875:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624587998976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967141.241881:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783967141.241921:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1d84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624587998976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967141.241954:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1d85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587998848:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783967141.431451:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967142.144438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967142.144487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967142.144609:0:18607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805824 00000100:00100000:0.0:1783967142.144635:0:18607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805824 00002000:00100000:0.0:1783967142.144707:0:18607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9a04c1f10700 x1870624563805824/t0(0) o4->47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp:303/0 lens 504/0 e 0 to 0 dl 1783967153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783967142.144719:0:18607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c1f10700 with x1870624563805824 ext(0->8) 00002000:00010000:0.0:1783967142.144725:0:18607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c1f10700 00000100:00100000:0.0:1783967142.144763:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967142.144821:0:18607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+8:2401:x1870624563805824:12345-192.168.204.59@tcp:4:bash.0 00000100:00080000:3.0:1783967142.145600:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967142.145894:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563805952 00000100:00100000:1.0:1783967142.145900:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563805952 00000100:00100000:1.0:1783967142.145959:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783967142.145968:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+11:2401:x1870624563805952:12345-192.168.204.59@tcp:16:kworker.0 00000001:00080000:2.0:1783967142.147762:0:18598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1783967142.147815:0:18598:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:3.0:1783967142.153969:0:18607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+7:2401:x1870624563805824:12345-192.168.204.59@tcp:4:bash.0 Request processed in 9136us (9528us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783967142.154004:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00002000:00100000:3.0:1783967142.154022:0:18607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9a04c1f10700 x1870624563805824/t8589934599(0) o4->47e19328-a632-4b1f-8ff8-755b3236cab4@192.168.204.59@tcp:303/0 lens 504/448 e 0 to 0 dl 1783967153 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1783967142.154048:0:18607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a04c1f10700 with x1870624563805824 ext(0->8) 00002000:00010000:3.0:1783967142.154055:0:18607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a04c1f10700 00000100:00100000:0.0:1783967142.159446:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2401:x1870624563805952:12345-192.168.204.59@tcp:16:kworker.0 Request processed in 13466us (14945us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967142.159462:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00010000:00010000:0.0:1783967142.455832:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43626 lines, 43626 kept, 0 dropped, 0 bad.